Jun 27 19:46:23 devstack cinder-volume[82436]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 27 19:46:23 devstack cinder-volume[82436]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 19:46:23 devstack cinder-volume[82436]: we strongly recommend against using it for new projects. Jun 27 19:46:23 devstack cinder-volume[82436]: If you are already using Eventlet, we recommend migrating to a different Jun 27 19:46:23 devstack cinder-volume[82436]: framework. For more detail see Jun 27 19:46:23 devstack cinder-volume[82436]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 19:46:23 devstack cinder-volume[82436]: import eventlet # noqa Jun 27 19:46:25 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:46:25 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:46:25 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:46:26 devstack cinder-volume[82436]: INFO dbcounter [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Registered counter for database cinder Jun 27 19:46:26 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG dbcounter [-] [82436] Writer thread running {{(pid=82436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.rpc [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.rpc [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.volume.manager [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Determined volume DB was empty at startup. Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG cinder.volume.manager [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82436) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.volume.manager [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 27 19:46:27 devstack cinder-volume[82436]: WARNING stevedore.named [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 19:46:27 devstack cinder-volume[82436]: WARNING castellan.key_manager [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:46:27 devstack cinder-volume[82436]: WARNING cinder.keymgr.conf_key_mgr [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG cinder.volume.drivers.lvm [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82436) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG oslo_concurrency.processutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG oslo_concurrency.processutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.537s {{(pid=82436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:27 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.rpc [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.rpc [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 27 19:46:27 devstack cinder-volume[82436]: WARNING stevedore.named [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 19:46:27 devstack cinder-volume[82436]: WARNING castellan.key_manager [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:46:27 devstack cinder-volume[82436]: INFO cinder.volume.manager [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_db.sqlalchemy.engines [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:46:28 devstack cinder-volume[82436]: INFO oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Starting 1 workers Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Started child 82604 {{(pid=82436) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Full set of CONF: {{(pid=82436) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] ******************************************************************************** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Configuration options gathered from: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] ================================================================================ {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 27 19:46:28 devstack cinder-volume[82604]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] allow_availability_zone_fallback = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] allow_compression_on_image_upload = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] allowed_direct_url_schemes = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] api_rate_limit = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] auth_strategy = keystone {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] az_cache_duration = 3600 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_availability_zone = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_host = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_stats_polling_interval = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backup_api_class = cinder.backup.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backup_name_template = backup-%s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backup_use_same_host = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backup_use_temp_snapshot = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] chap_password = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] chap_username = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_internal_tenant_project_id = a3115e6cac8542fd84fe2d5ae50651c3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_internal_tenant_user_id = ad19bae87f474cdc9e9a6a2a45184734 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cloned_volume_same_az = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cluster = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] compression_format = gzip {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] compute_api_class = cinder.compute.nova.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] config_dir = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] config_source = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] control_exchange = openstack {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] debug = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] default_availability_zone = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] default_group_type = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] default_volume_type = lvmdriver-1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] disk_geometry = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] driver_client_cert = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] driver_client_cert_key = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] driver_data_namespace = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] driver_ssl_cert_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] driver_ssl_cert_verify = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] driver_use_ssl = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] enable_force_upload = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] enable_new_services = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] enable_unsupported_driver = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] enforce_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] filter_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_api_insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_api_ssl_compression = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_ca_certificates_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_catalog_info = image:glance:publicURL {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_num_retries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance_request_timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] goodness_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] graceful_shutdown_timeout = 5 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] group_api_class = cinder.group.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] host = devstack {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_compress_on_upload = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_conversion_address_space_limit = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_conversion_cpu_limit = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_conversion_disable = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_upload_use_cinder_backend = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_upload_use_internal_tenant = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_volume_cache_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_volume_cache_max_count = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] image_volume_cache_max_size_gb = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] init_host_max_objects_retrieval = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] instance_format = [instance: %(uuid)s] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] iscsi_target_flags = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] iscsi_write_cache = on {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] iser_helper = tgtadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] iser_ip_address = 192.168.122.200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] iser_port = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_color = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_config_append = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_dir = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_options = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_rotate_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_rotate_interval_type = days {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] log_rotation_type = none {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] max_age = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] max_logfile_count = 30 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] max_logfile_size_mb = 200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] max_over_subscription_ratio = 20.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] message_reap_interval = 86400 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] message_ttl = 2592000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] migration_create_volume_timeout_secs = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] monkey_patch = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] monkey_patch_modules = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] my_ip = 192.168.122.200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] no_snapshot_gb_quota = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] num_iser_scan_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] num_shell_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] num_volume_device_scan_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] nvmeof_conn_info_version = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] nvmet_ns_id = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] nvmet_port_id = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_max_limit = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_volume_ext_list = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_volume_listen_port = 8776 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_volume_use_ssl = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] osapi_volume_workers = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] per_volume_size_limit = -1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] periodic_fuzzy_delay = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] periodic_interval = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] public_endpoint = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] publish_errors = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_backup_gigabytes = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_backups = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_gigabytes = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_groups = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_snapshots = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] quota_volumes = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] rate_limit_burst = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] rate_limit_except_level = CRITICAL {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] rate_limit_interval = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] reinit_driver_count = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] replication_device = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] report_discard_supported = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] report_interval = 120 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] reservation_clean_interval = 86400 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] reservation_expire = 86400 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] reserved_image_namespaces = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] reserved_percentage = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] rpc_response_timeout = 120 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] run_external_periodic_tasks = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] scst_target_driver = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] scst_target_iqn_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_down_time = 720 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] shell_completion = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] snapshot_name_template = snapshot-%s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] snapshot_same_host = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] split_loggers = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] state_path = /opt/stack/data/cinder {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] storage_availability_zone = nova {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] storage_protocol = iSCSI {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] syslog_log_facility = LOG_USER {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] target_helper = lioadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] target_ip_address = 192.168.122.200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] target_port = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] target_protocol = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] target_secondary_ip_addresses = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] trace_flags = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] transport_url = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] until_refresh = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_chap_auth = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_default_quota_class = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_journal = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_json = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_stderr = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] use_syslog = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] verify_glance_signatures = enabled {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_api_class = cinder.volume.api.API {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_backend_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_clear = zero {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_clear_ionice = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_clear_size = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_copy_bps_limit = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_dd_blocksize = 1M {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_name_template = volume-%s {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_service_inithost_offload = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volume_usage_audit_period = month {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] zoning_mode = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_concurrency.disable_process_locking = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.auth_section = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.auth_type = password {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.auth_version = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.cache = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.include_service_catalog = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.interface = public {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_password = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcache_username = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.region_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.service_type = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.backend = dogpile.cache.null {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.backend_argument = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.backend_expiration_time = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.config_prefix = cache.oslo {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.debug_cache_backend = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.enable_retry_client = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.enable_socket_keepalive = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.expiration_time = 600 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.hashclient_retry_attempts = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_dead_retry = 300 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack sudo[82608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 27 19:46:28 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_pool_maxsize = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_sasl_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.password = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.proxies = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.redis_db = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.redis_server = localhost:6379 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.retry_attempts = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.retry_delay = 0.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.socket_keepalive_count = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.socket_keepalive_idle = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.socket_keepalive_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.socket_timeout = 1.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.tls_allowed_ciphers = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.tls_cafile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.tls_certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.tls_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.tls_keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cache.username = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] coordination.backend_url = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.asyncio_connection = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.asyncio_slave_connection = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.backend = sqlalchemy {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.connection = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.connection_debug = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.connection_parameters = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.connection_recycle_time = 3600 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.connection_trace = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.db_inc_retry_interval = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.db_max_retries = 20 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.db_max_retry_interval = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.db_retry_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.max_overflow = 50 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.max_pool_size = 5 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.max_retries = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.mysql_wsrep_sync_wait = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.pool_timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.retry_interval = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.slave_connection = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.sqlite_synchronous = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.synchronous_reader = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] database.use_db_reconnect = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.connection_string = messaging:// {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.es_doc_type = notification {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.es_scroll_size = 10000 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.es_scroll_time = 2m {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.filter_error_trace = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.hmac_keys = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.sentinel_service_name = mymaster {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.socket_timeout = 0.1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.trace_requests = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler.trace_sqlalchemy = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler_jaeger.process_tags = {} {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler_jaeger.service_name_prefix = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] profiler_otlp.service_name_prefix = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.enforce_new_defaults = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: WARNING oslo_config.cfg [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.enforce_scope = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.policy_default_rule = default {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.policy_file = policy.yaml {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.group = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.helper_command = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] privsep_osbrick.user = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.group = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.helper_command = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] cinder_sys_admin.user = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.auth_section = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.auth_type = password {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.cafile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.collect_timing = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.send_service_user_token = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.split_loggers = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] service_user.timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.auth_section = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.auth_type = password {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.collect_timing = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.region_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.split_loggers = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] glance.timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.backend_availability_zone = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.chap_password = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.chap_username = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.disk_geometry = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.driver_client_cert = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.driver_client_cert_key = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.driver_data_namespace = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.driver_use_ssl = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.extra_capabilities = {} {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.filter_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.goodness_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.iscsi_target_flags = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.iscsi_write_cache = on {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.iser_helper = tgtadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.iser_port = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.lvm_share_target = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.lvm_type = auto {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.num_shell_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.replication_device = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.report_discard_supported = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.reserved_percentage = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.target_helper = tgtadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.target_port = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.target_protocol = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.trace_flags = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.unique_fqdn_network = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.use_chap_auth = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_backend_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_clear = zero {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_clear_ionice = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_clear_size = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_reports.file_event_handler = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_reports.log_dir = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.backend_host = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.chap_password = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.chap_username = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.disk_geometry = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.driver_client_cert = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.extra_capabilities = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.filter_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.goodness_function = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.iser_helper = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.iser_ip_address = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.iser_port = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.lvm_share_target = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.lvm_type = auto {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.num_shell_tries = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.replication_device = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.report_discard_supported = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.reserved_percentage = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.scst_target_driver = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.storage_protocol = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.target_helper = lioadm {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.target_ip_address = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.target_port = 3260 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.trace_flags = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.use_chap_auth = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_clear = zero {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_clear_size = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] lvmdriver-1.volumes_dir = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_notifications.driver = [] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_notifications.retry = -1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] key_manager.fixed_key = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.barbican_api_version = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.barbican_endpoint = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.barbican_endpoint_type = public {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.barbican_region_name = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.cafile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.collect_timing = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.number_of_retries = 60 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.retry_delay = 1 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.send_service_user_token = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.split_loggers = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.verify_ssl = True {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican.verify_ssl_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.auth_section = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.auth_type = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.cafile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.certfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.collect_timing = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.insecure = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.keyfile = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.split_loggers = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] barbican_service_user.timeout = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.approle_role_id = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.approle_secret_id = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.kv_mountpoint = secret {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.kv_path = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.kv_version = 2 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.namespace = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.root_token_id = **** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.ssl_ca_crt_file = None {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.timeout = 60.0 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.use_ssl = False {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:46:28 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] ******************************************************************************** {{(pid=82436) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 27 19:46:28 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:28 devstack sudo[82764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:28 devstack sudo[82764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:29 devstack sudo[82764]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.705s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 19:46:29 devstack cinder-volume[82604]: INFO cinder.brick.local_dev.lvm [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 27 19:46:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:29 devstack sudo[83022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:46:29 devstack sudo[83022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:30 devstack sudo[83022]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:30 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:30 devstack cinder-volume[82604]: DEBUG cinder.brick.local_dev.lvm [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82604) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 27 19:46:30 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:30 devstack sudo[83175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:30 devstack sudo[83175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:31 devstack sudo[83175]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.127s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:31 devstack sudo[83382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:31 devstack sudo[83382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:32 devstack sudo[83382]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:32 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.711s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:32 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:32 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:32 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:32 devstack sudo[83387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 27 19:46:32 devstack sudo[83387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:33 devstack sudo[83387]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.706s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:33 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:46:33 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:33 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:33 devstack sudo[83404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:46:33 devstack sudo[83404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:34 devstack sudo[83404]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:34 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.823s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:34 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:34 devstack sudo[83408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:34 devstack sudo[83408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:35 devstack sudo[83408]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:35 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.986s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:35 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:35 devstack sudo[83415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:35 devstack sudo[83415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:36 devstack sudo[83415]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:36 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:36 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:36 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:36 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:36 devstack sudo[83423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:36 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:37 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.776s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:37 devstack cinder-volume[82604]: INFO cinder.volume.drivers.lvm [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:37 devstack sudo[83463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:37 devstack sudo[83463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:37 devstack sudo[83463]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:46:37 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:37 devstack sudo[83549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:46:37 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:38 devstack cinder-volume[82436]: DEBUG dbcounter [-] [82436] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:46:38 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:38 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:38 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:38 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:38 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:39 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:39 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:39 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:39 devstack sudo[83694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:39 devstack sudo[83694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:39 devstack sudo[83694]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:39 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:39 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:39 devstack sudo[83697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:39 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:40 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:40 devstack cinder-volume[82604]: INFO cinder.volume.driver [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Driver hasn't implemented _init_vendor_properties() Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG cinder.volume.driver [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82604) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG oslo_db.sqlalchemy.engines [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writer thread running {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG cinder.db.api [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Building query based on filter {{(pid=82604) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG cinder.image.image_utils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82604) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 27 19:46:40 devstack cinder-volume[82604]: INFO cinder.keymgr.migration [None req-70951110-67e9-4652-8db2-fbe8b3064e50 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:46:40 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:40 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:46:40 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:41 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:41 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:41 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:41 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:41 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:41 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:41 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:41 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:41 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:41 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:42 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:42 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:42 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:42 devstack sudo[83714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:42 devstack sudo[83714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:42 devstack sudo[83714]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:42 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:46:43 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Driver initialization completed successfully. Jun 27 19:46:43 devstack cinder-volume[82604]: INFO cinder.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Initiating service 2 cleanup Jun 27 19:46:43 devstack cinder-volume[82604]: INFO cinder.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Service 2 cleanup completed. Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG cinder.service [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Creating RPC server for service cinder-volume {{(pid=82604) start /opt/stack/cinder/cinder/service.py:231}} Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG cinder.service [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82604) start /opt/stack/cinder/cinder/service.py:237}} Jun 27 19:46:43 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:43 devstack sudo[83719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:46:43 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:43 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:43 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:43 devstack sudo[83726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:43 devstack sudo[83726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:44 devstack sudo[83726]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:44 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:44 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:44 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:46:44 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:45 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:45 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:45 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:46:45 devstack sudo[83786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:46:45 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:46:45 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root Jun 27 19:46:45 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:46:45 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-83779607-3335-4ca8-9128-e9ce20fe7e29 None None] Driver post RPC initialization completed successfully. Jun 27 19:46:55 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=3 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:46:55 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:47:12 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:47:12 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:47:12 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread info: [<_MainThread(MainThread, started 131293837987968)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:48:12 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:48:12 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:48:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:48:12 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:48:12 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:48:13 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Jun 27 19:48:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:48:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:48:13 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:48:13 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:48:14 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Jun 27 19:48:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:48:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:48:14 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:48:14 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:48:14 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Jun 27 19:48:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:48:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:48:14 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:48:14 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:48:15 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Jun 27 19:48:15 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:48:15 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:48:15 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:48:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:48:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread info: [<_MainThread(MainThread, started 131293837987968)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:48:55 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:49:12 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:49:12 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:49:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:49:12 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:49:12 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:49:13 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Jun 27 19:49:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:49:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:49:13 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:49:13 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:49:14 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Jun 27 19:49:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:49:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:49:14 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:49:14 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:49:14 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Jun 27 19:49:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:49:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:49:14 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:49:14 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:49:15 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Jun 27 19:49:15 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:49:15 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:49:15 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:49:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:49:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread info: [<_MainThread(MainThread, started 131293837987968)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:50:12 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:50:12 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:50:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:50:12 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:50:12 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:50:13 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jun 27 19:50:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:50:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:50:13 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:50:13 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:50:14 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Jun 27 19:50:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:50:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:50:14 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:50:14 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:50:14 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jun 27 19:50:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:50:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:50:14 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:50:14 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:50:15 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Jun 27 19:50:15 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:50:15 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:50:55 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:50:55 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:UPDATE=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:51:12 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:51:12 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 19:51:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:12 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 19:51:12 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:13 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:13 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:51:13 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:14 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:14 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 19:51:14 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:14 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:14 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 19:51:14 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:15 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:15 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:15 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:51:15 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:51:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:51:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7cba187-6aa2-476c-a6a7-ea00fd89c84c None None] thread info: [<_MainThread(MainThread, started 131293837987968)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:51:29 devstack cinder-volume[82436]: INFO oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Caught SIGTERM, stopping children Jun 27 19:51:29 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Acquiring lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:51:29 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Acquired lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:51:29 devstack cinder-volume[82436]: DEBUG oslo_concurrency.lockutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Releasing lock "singleton_lock" {{(pid=82436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:51:29 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Stop services. {{(pid=82436) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 27 19:51:29 devstack cinder-volume[82436]: DEBUG oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Killing children. {{(pid=82436) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 27 19:51:29 devstack cinder-volume[82436]: INFO oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Waiting on 1 children to exit Jun 27 19:51:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Acquiring lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:51:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Acquired lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:51:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Releasing lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:51:33 devstack cinder-volume[82604]: WARNING amqp [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 19:51:33 devstack cinder-volume[82604]: WARNING amqp [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 19:51:33 devstack cinder-volume[82436]: INFO oslo_service.backend._eventlet.service [None req-597f94f0-b849-448e-9228-edf27c37cba2 None None] Child 82604 exited with status 0 Jun 27 19:51:33 devstack cinder-volume[92697]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 27 19:51:33 devstack cinder-volume[92697]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 19:51:33 devstack cinder-volume[92697]: we strongly recommend against using it for new projects. Jun 27 19:51:33 devstack cinder-volume[92697]: If you are already using Eventlet, we recommend migrating to a different Jun 27 19:51:33 devstack cinder-volume[92697]: framework. For more detail see Jun 27 19:51:33 devstack cinder-volume[92697]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 19:51:33 devstack cinder-volume[92697]: import eventlet # noqa Jun 27 19:51:35 devstack cinder-volume[92697]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:51:35 devstack cinder-volume[92697]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:51:35 devstack cinder-volume[92697]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:51:36 devstack cinder-volume[92697]: INFO dbcounter [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Registered counter for database cinder Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_db.sqlalchemy.engines [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG dbcounter [-] [92697] Writer thread running {{(pid=92697) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 19:51:36 devstack cinder-volume[92697]: INFO cinder.rpc [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 27 19:51:36 devstack cinder-volume[92697]: INFO cinder.rpc [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_db.sqlalchemy.engines [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:36 devstack cinder-volume[92697]: INFO cinder.volume.manager [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Determined volume DB was empty at startup. Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG cinder.volume.manager [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92697) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 27 19:51:36 devstack cinder-volume[92697]: INFO cinder.volume.manager [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 27 19:51:36 devstack cinder-volume[92697]: WARNING stevedore.named [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 19:51:36 devstack cinder-volume[92697]: WARNING castellan.key_manager [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:51:36 devstack cinder-volume[92697]: WARNING cinder.keymgr.conf_key_mgr [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:51:36 devstack cinder-volume[92697]: INFO cinder.volume.manager [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_db.sqlalchemy.engines [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:36 devstack cinder-volume[92697]: INFO oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Starting 1 workers Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Started child 92913 {{(pid=92697) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Full set of CONF: {{(pid=92697) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] ******************************************************************************** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Configuration options gathered from: {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] ================================================================================ {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 27 19:51:36 devstack cinder-volume[92913]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] allow_availability_zone_fallback = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] allow_compression_on_image_upload = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] allowed_direct_url_schemes = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] api_rate_limit = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] auth_strategy = keystone {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_availability_zone = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_host = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_stats_polling_interval = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backup_api_class = cinder.backup.api.API {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backup_name_template = backup-%s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backup_use_same_host = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backup_use_temp_snapshot = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] chap_password = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] chap_username = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_internal_tenant_project_id = a3115e6cac8542fd84fe2d5ae50651c3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_internal_tenant_user_id = ad19bae87f474cdc9e9a6a2a45184734 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cluster = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] compression_format = gzip {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] compute_api_class = cinder.compute.nova.API {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] config_dir = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] config_source = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] control_exchange = openstack {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] debug = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] default_availability_zone = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] default_group_type = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] default_volume_type = QuobyteHD {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] disk_geometry = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] driver_client_cert = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] driver_client_cert_key = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] driver_data_namespace = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] driver_ssl_cert_path = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] driver_ssl_cert_verify = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] driver_use_ssl = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] enable_new_services = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] enable_unsupported_driver = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] enabled_backends = ['QuobyteHD'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] enforce_multipath_for_image_xfer = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] filter_function = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_api_insecure = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_api_ssl_compression = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_ca_certificates_file = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_catalog_info = image:glance:publicURL {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_num_retries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance_request_timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] goodness_function = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] graceful_shutdown_timeout = 5 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] group_api_class = cinder.group.api.API {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] host = devstack {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_compress_on_upload = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_conversion_address_space_limit = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_conversion_cpu_limit = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_conversion_disable = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_upload_use_cinder_backend = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_upload_use_internal_tenant = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_volume_cache_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_volume_cache_max_count = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] image_volume_cache_max_size_gb = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] init_host_max_objects_retrieval = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] instance_format = [instance: %(uuid)s] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] iscsi_target_flags = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] iscsi_write_cache = on {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] iser_helper = tgtadm {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] iser_ip_address = 192.168.122.200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] iser_port = 3260 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_color = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Starting volume driver QuobyteDriver (1.1.14) Jun 27 19:51:36 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.remotefs [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92913) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_config_append = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_dir = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_file = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_options = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_rotate_interval = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_rotate_interval_type = days {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] log_rotation_type = none {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] max_age = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] max_logfile_count = 30 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] max_logfile_size_mb = 200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] max_over_subscription_ratio = 20.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] message_reap_interval = 86400 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] message_ttl = 2592000 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] migration_create_volume_timeout_secs = 300 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] monkey_patch = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] monkey_patch_modules = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] my_ip = 192.168.122.200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] no_snapshot_gb_quota = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] num_iser_scan_tries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] num_shell_tries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] num_volume_device_scan_tries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] nvmeof_conn_info_version = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] nvmet_ns_id = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] nvmet_port_id = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_max_limit = 1000 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_volume_ext_list = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_volume_listen_port = 8776 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_volume_use_ssl = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] osapi_volume_workers = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] per_volume_size_limit = -1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] periodic_fuzzy_delay = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] periodic_interval = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] public_endpoint = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] publish_errors = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_backup_gigabytes = 1000 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_backups = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_gigabytes = 1000 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_groups = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_snapshots = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] quota_volumes = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:36 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] rate_limit_burst = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] rate_limit_except_level = CRITICAL {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] rate_limit_interval = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] reinit_driver_count = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] replication_device = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] report_discard_supported = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] report_interval = 120 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] reservation_clean_interval = 86400 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] reservation_expire = 86400 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] reserved_image_namespaces = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] reserved_percentage = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] rpc_response_timeout = 120 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] run_external_periodic_tasks = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] scst_target_driver = iscsi {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] scst_target_iqn_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_down_time = 720 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] shell_completion = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] snapshot_name_template = snapshot-%s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] split_loggers = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] state_path = /opt/stack/data/cinder {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] storage_availability_zone = nova {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] storage_protocol = iSCSI {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] syslog_log_facility = LOG_USER {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] target_helper = lioadm {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] target_ip_address = 192.168.122.200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] target_port = 3260 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] target_protocol = iscsi {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] target_secondary_ip_addresses = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] trace_flags = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] transport_url = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] until_refresh = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_chap_auth = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_default_quota_class = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_journal = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_json = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_multipath_for_image_xfer = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_stderr = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] use_syslog = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] verify_glance_signatures = enabled {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_api_class = cinder.volume.api.API {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_backend_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_clear = zero {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_clear_ionice = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_clear_size = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_copy_bps_limit = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_dd_blocksize = 1M {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_name_template = volume-%s {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_service_inithost_offload = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volume_usage_audit_period = month {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] zoning_mode = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.auth_section = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.auth_type = password {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.auth_version = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.cache = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.include_service_catalog = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.insecure = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.interface = public {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_password = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcache_username = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.region_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.service_type = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.backend = dogpile.cache.null {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.backend_argument = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.backend_expiration_time = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.config_prefix = cache.oslo {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.debug_cache_backend = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.enable_retry_client = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.enable_socket_keepalive = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.expiration_time = 600 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_dead_retry = 300 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_pool_maxsize = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_sasl_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.password = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.proxies = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.redis_db = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.redis_server = localhost:6379 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.retry_attempts = 2 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.retry_delay = 0.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.socket_keepalive_count = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.socket_keepalive_idle = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.socket_keepalive_interval = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.socket_timeout = 1.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.tls_allowed_ciphers = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.tls_cafile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.tls_certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.tls_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.tls_keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cache.username = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] coordination.backend_url = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.asyncio_connection = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.asyncio_slave_connection = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.backend = sqlalchemy {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.connection = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.connection_debug = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.connection_parameters = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.connection_recycle_time = 3600 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92913) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 27 19:51:37 devstack cinder-volume[92913]: WARNING cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.connection_trace = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: WARNING cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.db_inc_retry_interval = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.db_max_retries = 20 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.db_max_retry_interval = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.db_retry_interval = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.max_overflow = 50 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Running cmd (subprocess): mount.quobyte {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.max_pool_size = 5 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.max_retries = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.pool_timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.retry_interval = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.slave_connection = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.sqlite_synchronous = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.synchronous_reader = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] database.use_db_reconnect = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.connection_string = messaging:// {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.es_doc_type = notification {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.es_scroll_size = 10000 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.es_scroll_time = 2m {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.filter_error_trace = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.hmac_keys = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.sentinel_service_name = mymaster {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.socket_timeout = 0.1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.trace_requests = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler.trace_sqlalchemy = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler_jaeger.process_tags = {} {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] profiler_otlp.service_name_prefix = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.enforce_new_defaults = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: WARNING oslo_config.cfg [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.enforce_scope = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.policy_default_rule = default {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.policy_file = policy.yaml {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.group = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.helper_command = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] privsep_osbrick.user = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.group = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.helper_command = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] cinder_sys_admin.user = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.auth_section = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.auth_type = password {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.cafile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.collect_timing = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.insecure = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.send_service_user_token = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.split_loggers = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] service_user.timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.auth_section = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.auth_type = password {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.collect_timing = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.insecure = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.region_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.split_loggers = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] glance.timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.backend_availability_zone = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.chap_password = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.chap_username = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.disk_geometry = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.driver_client_cert = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.driver_client_cert_key = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.driver_data_namespace = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.driver_use_ssl = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.extra_capabilities = {} {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.filter_function = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.goodness_function = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.iscsi_target_flags = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.iscsi_write_cache = on {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.iser_helper = tgtadm {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.iser_port = 3260 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_host = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_login = admin {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_mount_options = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_password = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_private_key = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_share_path = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.num_shell_tries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.quobyte_volume_url = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.replication_device = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.report_discard_supported = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.reserved_percentage = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.target_helper = tgtadm {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.target_port = 3260 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.target_protocol = iscsi {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.trace_flags = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.unique_fqdn_network = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.use_chap_auth = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_backend_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_clear = zero {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_clear_ionice = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_clear_size = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_reports.file_event_handler = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_reports.log_dir = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.backend_availability_zone = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.backend_host = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.chap_password = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.chap_username = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.chiscsi_conf = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.disk_geometry = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.driver_client_cert = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.driver_data_namespace = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.driver_use_ssl = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.extra_capabilities = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.filter_function = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.goodness_function = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.iser_helper = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.iser_ip_address = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.iser_port = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.iser_target_prefix = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: INFO cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 ... Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_host = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_login = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_mount_options = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_password = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 -c /etc/quobyte/client-cinder.cfg {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_private_key = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_share_path = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_ssh_port = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.num_shell_tries = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.nvmet_port_id = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.replication_device = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.report_discard_supported = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.reserved_percentage = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.scst_target_driver = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.storage_protocol = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.target_helper = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.target_ip_address = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.target_port = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.target_prefix = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.target_protocol = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.trace_flags = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.use_chap_auth = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_clear = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 -c /etc/quobyte/client-cinder.cfg Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_clear_size = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] QuobyteHD.volumes_dir = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_notifications.driver = [] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] key_manager.fixed_key = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.barbican_api_version = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.barbican_endpoint = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.barbican_endpoint_type = public {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.barbican_region_name = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.cafile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.collect_timing = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.insecure = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.number_of_retries = 60 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.retry_delay = 1 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.send_service_user_token = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.split_loggers = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.verify_ssl = True {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican.verify_ssl_path = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.auth_section = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.auth_type = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.cafile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.certfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.collect_timing = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.insecure = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.keyfile = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.split_loggers = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] barbican_service_user.timeout = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.approle_role_id = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.approle_secret_id = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.kv_mountpoint = secret {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.kv_path = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.kv_version = 2 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.namespace = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.root_token_id = **** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.ssl_ca_crt_file = None {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.timeout = 60.0 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.use_ssl = False {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:37 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] ******************************************************************************** {{(pid=92697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 27 19:51:37 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:37 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.758s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:37 devstack cinder-volume[92913]: INFO cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 succeeded Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.772s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:38 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:38 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:38 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.691s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:38 devstack cinder-volume[92913]: INFO cinder.volume.driver [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Driver hasn't implemented _init_vendor_properties() Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG cinder.volume.driver [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6862678527832, 'free_capacity_gb': 1775.6862678527832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92913) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_db.sqlalchemy.engines [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92913) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG dbcounter [-] [92913] Writer thread running {{(pid=92913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG cinder.db.api [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Building query based on filter {{(pid=92913) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG cinder.image.image_utils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92913) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 27 19:51:38 devstack cinder-volume[92913]: INFO cinder.keymgr.migration [None req-0b75f236-7709-4142-836e-4a33bb19ffcc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:38 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:38 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:38 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:39 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.691s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG cinder.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Notifying Schedulers of capabilities ... {{(pid=92913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:51:39 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Driver initialization completed successfully. Jun 27 19:51:39 devstack cinder-volume[92913]: INFO cinder.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Initiating service 3 cleanup Jun 27 19:51:39 devstack cinder-volume[92913]: INFO cinder.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Service 3 cleanup completed. Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG cinder.service [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Creating RPC server for service cinder-volume {{(pid=92913) start /opt/stack/cinder/cinder/service.py:231}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG cinder.service [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92913) start /opt/stack/cinder/cinder/service.py:237}} Jun 27 19:51:39 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:39 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:39 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:39 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:40 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:40 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.705s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:40 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-ac4194ca-66fb-4d49-af69-70ef4e85da0a None None] Driver post RPC initialization completed successfully. Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:44 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:44 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:44 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.682s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:44 devstack cinder-volume[92913]: DEBUG cinder.manager [None req-7ec9c9a8-e11b-4f30-a852-b7df900ea4e3 None None] Notifying Schedulers of capabilities ... {{(pid=92913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:51:46 devstack cinder-volume[92697]: DEBUG dbcounter [-] [92697] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92697) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:51:47 devstack cinder-volume[92697]: INFO oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Caught SIGTERM, stopping children Jun 27 19:51:47 devstack cinder-volume[92697]: DEBUG oslo_concurrency.lockutils [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Acquiring lock "singleton_lock" {{(pid=92697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:51:47 devstack cinder-volume[92697]: DEBUG oslo_concurrency.lockutils [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Acquired lock "singleton_lock" {{(pid=92697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:51:47 devstack cinder-volume[92697]: DEBUG oslo_concurrency.lockutils [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Releasing lock "singleton_lock" {{(pid=92697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:51:47 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Stop services. {{(pid=92697) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 27 19:51:47 devstack cinder-volume[92697]: DEBUG oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Killing children. {{(pid=92697) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 27 19:51:47 devstack cinder-volume[92697]: INFO oslo_service.backend._eventlet.service [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Waiting on 1 children to exit Jun 27 19:51:50 devstack cinder-volume[92913]: DEBUG dbcounter [-] [92913] Writing DB stats cinder:SELECT=2 {{(pid=92913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:51:50 devstack cinder-volume[92913]: DEBUG dbcounter [-] [92913] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:51:52 devstack cinder-volume[92913]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 27 19:51:52 devstack cinder-volume[93205]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 27 19:51:52 devstack cinder-volume[93205]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 19:51:52 devstack cinder-volume[93205]: we strongly recommend against using it for new projects. Jun 27 19:51:52 devstack cinder-volume[93205]: If you are already using Eventlet, we recommend migrating to a different Jun 27 19:51:52 devstack cinder-volume[93205]: framework. For more detail see Jun 27 19:51:52 devstack cinder-volume[93205]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 19:51:52 devstack cinder-volume[93205]: import eventlet # noqa Jun 27 19:51:52 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Acquiring lock "singleton_lock" {{(pid=92913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:51:52 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Acquired lock "singleton_lock" {{(pid=92913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:51:52 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Releasing lock "singleton_lock" {{(pid=92913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:51:52 devstack cinder-volume[92913]: WARNING amqp [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 19:51:53 devstack cinder-volume[92913]: WARNING amqp [None req-eb8a0d22-8d48-4e43-a24a-001ae29db5d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 19:51:55 devstack cinder-volume[93205]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 19:51:55 devstack cinder-volume[93205]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 19:51:55 devstack cinder-volume[93205]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 19:51:56 devstack cinder-volume[93205]: INFO dbcounter [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Registered counter for database cinder Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_db.sqlalchemy.engines [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG dbcounter [-] [93205] Writer thread running {{(pid=93205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 19:51:56 devstack cinder-volume[93205]: INFO cinder.rpc [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 27 19:51:56 devstack cinder-volume[93205]: INFO cinder.rpc [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_db.sqlalchemy.engines [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:56 devstack cinder-volume[93205]: INFO cinder.volume.manager [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Determined volume DB was empty at startup. Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG cinder.volume.manager [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93205) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 27 19:51:56 devstack cinder-volume[93205]: WARNING stevedore.named [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 19:51:56 devstack cinder-volume[93205]: WARNING castellan.key_manager [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:51:56 devstack cinder-volume[93205]: WARNING cinder.keymgr.conf_key_mgr [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 19:51:56 devstack cinder-volume[93205]: INFO cinder.volume.manager [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_db.sqlalchemy.engines [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:56 devstack cinder-volume[93205]: INFO oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Starting 1 workers Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Started child 93503 {{(pid=93205) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Full set of CONF: {{(pid=93205) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] ******************************************************************************** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Configuration options gathered from: {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] ================================================================================ {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] allow_availability_zone_fallback = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93503]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] allow_compression_on_image_upload = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] allowed_direct_url_schemes = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] api_rate_limit = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] auth_strategy = keystone {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_availability_zone = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_host = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_stats_polling_interval = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backup_api_class = cinder.backup.api.API {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backup_name_template = backup-%s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backup_use_same_host = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backup_use_temp_snapshot = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] chap_password = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] chap_username = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_internal_tenant_project_id = a3115e6cac8542fd84fe2d5ae50651c3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_internal_tenant_user_id = ad19bae87f474cdc9e9a6a2a45184734 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cluster = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] compression_format = gzip {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] compute_api_class = cinder.compute.nova.API {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] config_dir = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] config_source = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] control_exchange = openstack {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] debug = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] default_availability_zone = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] default_group_type = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] default_volume_type = QuobyteHD {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] disk_geometry = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] driver_client_cert = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] driver_client_cert_key = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] driver_data_namespace = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] driver_ssl_cert_path = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] driver_ssl_cert_verify = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] driver_use_ssl = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] enable_new_services = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] enable_unsupported_driver = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] enabled_backends = ['QuobyteHD'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] enforce_multipath_for_image_xfer = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] filter_function = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_api_insecure = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_api_ssl_compression = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_ca_certificates_file = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_catalog_info = image:glance:publicURL {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_num_retries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance_request_timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] goodness_function = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] graceful_shutdown_timeout = 5 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] group_api_class = cinder.group.api.API {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] host = devstack {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_compress_on_upload = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_conversion_address_space_limit = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_conversion_cpu_limit = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_conversion_disable = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_upload_use_cinder_backend = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_upload_use_internal_tenant = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_volume_cache_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_volume_cache_max_count = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] image_volume_cache_max_size_gb = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] init_host_max_objects_retrieval = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] instance_format = [instance: %(uuid)s] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] iscsi_target_flags = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] iscsi_write_cache = on {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] iser_helper = tgtadm {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] iser_ip_address = 192.168.122.200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] iser_port = 3260 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_color = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_config_append = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_dir = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_file = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_options = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_rotate_interval = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_rotate_interval_type = days {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] log_rotation_type = none {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] max_age = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] max_logfile_count = 30 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] max_logfile_size_mb = 200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] max_over_subscription_ratio = 20.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] message_reap_interval = 86400 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] message_ttl = 2592000 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] migration_create_volume_timeout_secs = 300 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] monkey_patch = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] monkey_patch_modules = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] my_ip = 192.168.122.200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] no_snapshot_gb_quota = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] num_iser_scan_tries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] num_shell_tries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] num_volume_device_scan_tries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] nvmeof_conn_info_version = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] nvmet_ns_id = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] nvmet_port_id = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_max_limit = 1000 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_volume_ext_list = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_volume_listen_port = 8776 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_volume_use_ssl = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] osapi_volume_workers = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] per_volume_size_limit = -1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Starting volume driver QuobyteDriver (1.1.14) Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93503) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] periodic_fuzzy_delay = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] periodic_interval = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] public_endpoint = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] publish_errors = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_backup_gigabytes = 1000 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_backups = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_gigabytes = 1000 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_groups = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_snapshots = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] quota_volumes = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] rate_limit_burst = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] rate_limit_except_level = CRITICAL {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] rate_limit_interval = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] reinit_driver_count = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] replication_device = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] report_discard_supported = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] report_interval = 120 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] reservation_clean_interval = 86400 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] reservation_expire = 86400 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] reserved_image_namespaces = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] reserved_percentage = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] rpc_response_timeout = 120 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] run_external_periodic_tasks = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] scst_target_driver = iscsi {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] scst_target_iqn_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_down_time = 720 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] shell_completion = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] snapshot_name_template = snapshot-%s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] split_loggers = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] state_path = /opt/stack/data/cinder {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] storage_availability_zone = nova {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] storage_protocol = iSCSI {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] syslog_log_facility = LOG_USER {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] target_helper = lioadm {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] target_ip_address = 192.168.122.200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] target_port = 3260 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] target_protocol = iscsi {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] target_secondary_ip_addresses = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] trace_flags = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] transport_url = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] until_refresh = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_chap_auth = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_default_quota_class = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_journal = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_json = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_multipath_for_image_xfer = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_stderr = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] use_syslog = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] verify_glance_signatures = enabled {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_api_class = cinder.volume.api.API {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_backend_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_clear = zero {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_clear_ionice = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_clear_size = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_copy_bps_limit = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_dd_blocksize = 1M {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_name_template = volume-%s {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_service_inithost_offload = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volume_usage_audit_period = month {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] zoning_mode = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_concurrency.disable_process_locking = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.auth_section = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.auth_type = password {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.auth_version = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.cache = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.include_service_catalog = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.insecure = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.interface = public {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_password = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcache_username = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.region_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.service_type = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.backend = dogpile.cache.null {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.backend_argument = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.backend_expiration_time = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.config_prefix = cache.oslo {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.debug_cache_backend = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.enable_retry_client = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.enable_socket_keepalive = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.expiration_time = 600 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.hashclient_retry_attempts = 2 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_dead_retry = 300 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_pool_maxsize = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_sasl_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.password = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93503) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 27 19:51:56 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 27 19:51:56 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.proxies = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.redis_db = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Running cmd (subprocess): mount.quobyte {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.redis_server = localhost:6379 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.retry_attempts = 2 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.retry_delay = 0.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.socket_keepalive_count = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.socket_keepalive_idle = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.socket_keepalive_interval = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.socket_timeout = 1.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.tls_allowed_ciphers = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.tls_cafile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.tls_certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.tls_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.tls_keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cache.username = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] coordination.backend_url = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.asyncio_connection = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.asyncio_slave_connection = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.backend = sqlalchemy {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.connection = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.connection_debug = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.connection_parameters = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.connection_recycle_time = 3600 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.connection_trace = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.db_inc_retry_interval = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.db_max_retries = 20 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.db_max_retry_interval = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.db_retry_interval = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.max_overflow = 50 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.max_pool_size = 5 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.max_retries = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.mysql_wsrep_sync_wait = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.pool_timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.retry_interval = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.slave_connection = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.sqlite_synchronous = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.synchronous_reader = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] database.use_db_reconnect = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.connection_string = messaging:// {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.es_doc_type = notification {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.es_scroll_size = 10000 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.es_scroll_time = 2m {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.filter_error_trace = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.hmac_keys = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.sentinel_service_name = mymaster {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.socket_timeout = 0.1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.trace_requests = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler.trace_sqlalchemy = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler_jaeger.process_tags = {} {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler_jaeger.service_name_prefix = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] profiler_otlp.service_name_prefix = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.enforce_new_defaults = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: WARNING oslo_config.cfg [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.enforce_scope = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.policy_default_rule = default {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.policy_file = policy.yaml {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.group = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.helper_command = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] privsep_osbrick.user = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.group = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.helper_command = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] cinder_sys_admin.user = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.auth_section = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.auth_type = password {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.cafile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.collect_timing = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.insecure = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.send_service_user_token = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.split_loggers = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] service_user.timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.auth_section = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.auth_type = password {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.collect_timing = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.insecure = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.region_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.split_loggers = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] glance.timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.backend_availability_zone = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack quobyte-client[93517]: Reading configuration file: /etc/quobyte/client.cfg Jun 27 19:51:56 devstack quobyte-client[93517]: Invalid parameters found, error: missing mount point. Jun 27 19:51:56 devstack quobyte-client[93517]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 27 19:51:56 devstack quobyte-client[93517]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.chap_password = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.chap_username = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.disk_geometry = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.driver_client_cert = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.driver_client_cert_key = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.driver_data_namespace = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.driver_use_ssl = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.extra_capabilities = {} {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.filter_function = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.goodness_function = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.iscsi_target_flags = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.iscsi_write_cache = on {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.iser_helper = tgtadm {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.iser_port = 3260 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_host = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_login = admin {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_mount_options = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_password = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_private_key = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_share_path = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.num_shell_tries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.quobyte_volume_url = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.replication_device = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.report_discard_supported = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.reserved_percentage = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.target_helper = tgtadm {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.target_port = 3260 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.target_protocol = iscsi {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.trace_flags = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.unique_fqdn_network = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.use_chap_auth = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_backend_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_clear = zero {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_clear_ionice = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_clear_size = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_reports.file_event_handler = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_reports.log_dir = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.backend_availability_zone = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.backend_host = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.chap_password = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.chap_username = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.chiscsi_conf = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.disk_geometry = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.driver_client_cert = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.driver_data_namespace = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.driver_use_ssl = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.extra_capabilities = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:56 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.filter_function = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.goodness_function = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.iser_helper = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.iser_ip_address = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.iser_port = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.iser_target_prefix = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_host = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_login = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_mount_options = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_password = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_private_key = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_share_path = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_ssh_port = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.num_shell_tries = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.nvmet_port_id = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.replication_device = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.report_discard_supported = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.reserved_percentage = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.scst_target_driver = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.storage_protocol = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.target_helper = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.target_ip_address = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.target_port = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.target_prefix = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.target_protocol = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.trace_flags = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.use_chap_auth = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_clear = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_clear_size = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] QuobyteHD.volumes_dir = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_notifications.driver = [] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_notifications.retry = -1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] key_manager.fixed_key = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.barbican_api_version = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.barbican_endpoint = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.barbican_endpoint_type = public {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.barbican_region_name = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.cafile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.collect_timing = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.insecure = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.number_of_retries = 60 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.retry_delay = 1 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.send_service_user_token = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.split_loggers = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.verify_ssl = True {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican.verify_ssl_path = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.auth_section = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.auth_type = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.cafile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.certfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.collect_timing = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.insecure = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.keyfile = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.split_loggers = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] barbican_service_user.timeout = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.approle_role_id = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.approle_secret_id = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.kv_mountpoint = secret {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.kv_path = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.kv_version = 2 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.namespace = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.root_token_id = **** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.ssl_ca_crt_file = None {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.timeout = 60.0 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.use_ssl = False {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 19:51:57 devstack cinder-volume[93205]: DEBUG oslo_service.backend._eventlet.service [None req-ac850af6-2a89-43be-98f4-1a706ba06024 None None] ******************************************************************************** {{(pid=93205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 27 19:51:57 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.688s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:57 devstack cinder-volume[93503]: INFO cinder.volume.driver [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Driver hasn't implemented _init_vendor_properties() Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG cinder.volume.driver [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.683692932129, 'free_capacity_gb': 1775.683692932129, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93503) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG oslo_db.sqlalchemy.engines [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93503) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writer thread running {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG cinder.db.api [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Building query based on filter {{(pid=93503) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93503) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:57 devstack cinder-volume[93503]: INFO cinder.keymgr.migration [None req-8c4a903e-7a3b-4799-92ae-42b6a60087a5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 27 19:51:57 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:57 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:58 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.622s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:51:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Driver initialization completed successfully. Jun 27 19:51:58 devstack cinder-volume[93503]: INFO cinder.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Initiating service 3 cleanup Jun 27 19:51:58 devstack cinder-volume[93503]: INFO cinder.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Service 3 cleanup completed. Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG cinder.service [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Creating RPC server for service cinder-volume {{(pid=93503) start /opt/stack/cinder/cinder/service.py:231}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG cinder.service [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93503) start /opt/stack/cinder/cinder/service.py:237}} Jun 27 19:51:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:51:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:51:58 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:51:58 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:51:59 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jun 27 19:51:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.606s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:51:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-776875c8-700d-4e01-a79e-63f3034cadac None None] Driver post RPC initialization completed successfully. Jun 27 19:52:06 devstack cinder-volume[93205]: DEBUG dbcounter [-] [93205] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:52:08 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:52:09 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=3 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:52:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:52:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 6 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:52:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:53:09 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:53:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Flow 'volume_create_manager' (c3f20af0-ba9b-4262-8dd5-6d3bd58a3d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:53:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04586ef1-34ca-4a1b-baa9-f0ec69c9b2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04586ef1-34ca-4a1b-baa9-f0ec69c9b2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-270056245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb411a7-02b2-4353-9c76-0baff2b2bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703ea6c0f92b43a285aec58e7185756a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:53:10Z,use_quota=True,user_id='2b8db2eb39964be589ca1453f306b6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89976436-5344-478e-b802-21500c7372d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89976436-5344-478e-b802-21500c7372d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31d69ff-0022-46c3-8aff-ca36e6df939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31d69ff-0022-46c3-8aff-ca36e6df939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb411a7-02b2-4353-9c76-0baff2b2bb46', 'volume_name': 'volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b91f7a-260c-4b63-8e56-edec3c7f8186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b91f7a-260c-4b63-8e56-edec3c7f8186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d544963b-6e08-461c-98c2-ef50128cdbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:10 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Volume 1fb411a7-02b2-4353-9c76-0baff2b2bb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46', 'volume_size': 1} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-270056245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb411a7-02b2-4353-9c76-0baff2b2bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703ea6c0f92b43a285aec58e7185756a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:53:10Z,use_quota=True,user_id='2b8db2eb39964be589ca1453f306b6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Creating volume 1fb411a7-02b2-4353-9c76-0baff2b2bb46 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:53:10 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:53:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:10 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 1073741824 Jun 27 19:53:10 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:13 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 1073741824" returned: 0 in 3.440s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:13 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 Jun 27 19:53:13 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:15 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46" returned: 0 in 2.069s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] <== create_volume: return (5648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:53:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.661s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d544963b-6e08-461c-98c2-ef50128cdbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0286704f-3f4a-4798-bc49-7ef076199c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:16 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Volume volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 (1fb411a7-02b2-4353-9c76-0baff2b2bb46): created successfully Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0286704f-3f4a-4798-bc49-7ef076199c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Flow 'volume_create_manager' (c3f20af0-ba9b-4262-8dd5-6d3bd58a3d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:53:16 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-36e569d3-5d71-4652-be0b-cfafd05f507b tempest-DeleteServersTestJSON-2032612524 None] Created volume successfully. Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:16 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:53:16 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:18 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.868s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:18 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:53:18 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:53:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 6 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:53:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:53:26 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:53:26 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:53:26 devstack cinder-volume[93503]: WARNING py.warnings [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 27 19:53:26 devstack cinder-volume[93503]: .first() Jun 27 19:53:26 devstack cinder-volume[93503]: Jun 27 19:53:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:26 devstack cinder-volume[93503]: INFO oslo.privsep.daemon [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkso3iouq/privsep.sock'] Jun 27 19:53:26 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkso3iouq/privsep.sock Jun 27 19:53:26 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 19:53:27 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 19:53:28 devstack cinder-volume[93503]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 27 19:53:28 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:28 devstack cinder-volume[93503]: INFO oslo.privsep.daemon [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Spawned new privsep daemon via rootwrap Jun 27 19:53:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Accepted privsep connection to /tmp/tmpkso3iouq/privsep.sock {{(pid=93503) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 27 19:53:28 devstack cinder-volume[93503]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 27 19:53:28 devstack cinder-volume[93503]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 27 19:53:28 devstack cinder-volume[93503]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 27 19:53:28 devstack cinder-volume[93503]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94950 Jun 27 19:53:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f45c0ac-ce15-4905-bc17-15259788ff28]: (2,) {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:53:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7868c1-dc4d-4fbb-ae12-590947618f99]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:53:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:28 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 Jun 27 19:53:28 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:29 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46" returned: 0 in 0.835s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.882s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2820b124-0d60-419f-ac73-5572388de554', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:53:29 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-81f0f295-5bb2-4140-9da7-6c3b749529a1 req-fb232500-be74-4268-a112-d68f61759882 tempest-DeleteServersTestJSON-2032612524 None] attachment_update completed successfully. Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Flow 'volume_create_manager' (37986db9-929d-4191-91d1-cb4f81185405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f277722a-b636-45b6-83ad-f1c463b7119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f277722a-b636-45b6-83ad-f1c463b7119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-616735780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd39ed6e-92c1-4233-98f6-3f0342e62d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588b637e3f56466e89dfaf744cbfe925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:53:39Z,use_quota=True,user_id='7c91c8da097c41d089d68a6520c64a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4e0953-4b9a-4826-81d0-e658d06b89c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4e0953-4b9a-4826-81d0-e658d06b89c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002a1259-810e-47b0-86f0-0c87d57b61aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002a1259-810e-47b0-86f0-0c87d57b61aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd39ed6e-92c1-4233-98f6-3f0342e62d04', 'volume_name': 'volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603b4533-bc2f-4d9f-90ba-0cd6fd39c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603b4533-bc2f-4d9f-90ba-0cd6fd39c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f8900c-9a24-4ddc-abd5-88767eeffd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Volume cd39ed6e-92c1-4233-98f6-3f0342e62d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04', 'volume_size': 1} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-616735780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd39ed6e-92c1-4233-98f6-3f0342e62d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588b637e3f56466e89dfaf744cbfe925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:53:39Z,use_quota=True,user_id='7c91c8da097c41d089d68a6520c64a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Creating volume cd39ed6e-92c1-4233-98f6-3f0342e62d04 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:53:38 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:53:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:38 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 1073741824 Jun 27 19:53:38 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:40 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 1073741824" returned: 0 in 1.264s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:40 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 Jun 27 19:53:40 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-db851618-878c-463a-8713-a3c65d33ea89 req-4468eb1c-3ca5-4eb2-a98a-b51cf445e3b9 tempest-DeleteServersTestJSON-2032612524 None] Terminate volume connection completed successfully. Jun 27 19:53:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-db851618-878c-463a-8713-a3c65d33ea89 req-4468eb1c-3ca5-4eb2-a98a-b51cf445e3b9 tempest-DeleteServersTestJSON-2032612524 None] Deleting attachment 2820b124-0d60-419f-ac73-5572388de554. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:53:40 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04" returned: 0 in 0.818s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:53:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f8900c-9a24-4ddc-abd5-88767eeffd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bf72cf-645b-40f4-ab10-5c0f58e54c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:41 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Volume volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 (cd39ed6e-92c1-4233-98f6-3f0342e62d04): created successfully Jun 27 19:53:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bf72cf-645b-40f4-ab10-5c0f58e54c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Flow 'volume_create_manager' (37986db9-929d-4191-91d1-cb4f81185405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:53:41 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b8106f86-1bb8-45f5-9f20-b238c8733f37 tempest-ServerRescueNegativeTestJSON-1539626822 None] Created volume successfully. Jun 27 19:53:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Acquiring lock "cinder-1fb411a7-02b2-4353-9c76-0baff2b2bb46-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:53:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Lock "cinder-1fb411a7-02b2-4353-9c76-0baff2b2bb46-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:53:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Acquiring lock "cinder-quobyte-1fb411a7-02b2-4353-9c76-0baff2b2bb46" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:53:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Lock "cinder-quobyte-1fb411a7-02b2-4353-9c76-0baff2b2bb46" acquired by "delete_volume" :: waited 0.046s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[525454ba-c4fb-400a-9030-8d36a15aa007]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:46 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 Jun 27 19:53:46 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Flow 'volume_create_manager' (42e07a41-4da7-4b64-878d-6b1118c8cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91c6b03-67c9-4b1d-bc56-8f957dff3237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91c6b03-67c9-4b1d-bc56-8f957dff3237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-237152437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3687b0-9623-4148-a458-2ebadcc3d43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b3d517de684d8c82788dabe0a3a991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:53:47Z,use_quota=True,user_id='7e89ea9c87bf4ac88bb3b40b447e1920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8566f6-86f5-49ac-9a60-9c26c41cf951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8566f6-86f5-49ac-9a60-9c26c41cf951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1384ae7-70be-43dc-b072-45d4960fe754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1384ae7-70be-43dc-b072-45d4960fe754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3687b0-9623-4148-a458-2ebadcc3d43b', 'volume_name': 'volume-9f3687b0-9623-4148-a458-2ebadcc3d43b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fb4cef-56fd-4d0e-8f1c-c02387a8adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fb4cef-56fd-4d0e-8f1c-c02387a8adc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82357b01-1ea2-48ea-b3a1-27b6853331ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:46 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Volume 9f3687b0-9623-4148-a458-2ebadcc3d43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3687b0-9623-4148-a458-2ebadcc3d43b', 'volume_size': 1} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-237152437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3687b0-9623-4148-a458-2ebadcc3d43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b3d517de684d8c82788dabe0a3a991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:53:47Z,use_quota=True,user_id='7e89ea9c87bf4ac88bb3b40b447e1920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Creating volume 9f3687b0-9623-4148-a458-2ebadcc3d43b {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:53:46 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:53:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:47 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b 1073741824 Jun 27 19:53:47 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:47 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46" returned: 0 in 1.579s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:47 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46 Jun 27 19:53:47 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1fb411a7-02b2-4353-9c76-0baff2b2bb46" returned: 0 in 0.964s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:48 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Lock "cinder-quobyte-1fb411a7-02b2-4353-9c76-0baff2b2bb46" released by "delete_volume" :: held 2.636s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:53:48 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b 1073741824" returned: 0 in 1.718s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:48 devstack cinder-volume[93503]: WARNING cinder.quota [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 27 19:53:48 devstack cinder-volume[93503]: WARNING cinder.quota [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 27 19:53:48 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Created reservations ['ee01b97a-8a7c-40fc-8265-d533eccdbadc', 'e8fa5168-e766-47b7-9f70-2bdc0d2914e0', '96081906-21e9-4d34-be96-0d2d2ec0e07d', '9305e128-a8bc-4ac1-9f93-2247f06e40a9'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:53:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:49 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b Jun 27 19:53:49 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:49 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:53:49 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:49 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.861s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:49 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:53:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Deleted volume successfully. Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c5ae5e2f-51cb-4308-b969-56fca23253e3 tempest-DeleteServersTestJSON-2032612524 None] Lock "cinder-1fb411a7-02b2-4353-9c76-0baff2b2bb46-delete_volume" released by "delete_volume" :: held 4.179s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:53:50 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b" returned: 0 in 1.065s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] <== create_volume: return (3095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.100s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82357b01-1ea2-48ea-b3a1-27b6853331ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3687b0-9623-4148-a458-2ebadcc3d43b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48524057-39ab-42ff-8326-577cb9ee5299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:53:50 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Volume volume-9f3687b0-9623-4148-a458-2ebadcc3d43b (9f3687b0-9623-4148-a458-2ebadcc3d43b): created successfully Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48524057-39ab-42ff-8326-577cb9ee5299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:53:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Flow 'volume_create_manager' (42e07a41-4da7-4b64-878d-6b1118c8cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:53:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-be188d92-06a6-471f-8a5f-9bd8e51e8899 tempest-AttachVolumeTestJSON-984368886 None] Created volume successfully. Jun 27 19:53:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:53:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:53:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd407729-ebcf-4ddb-8249-c87862d4601f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:53:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:53:55 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b Jun 27 19:53:55 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:53:57 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jun 27 19:53:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b" returned: 0 in 1.474s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:53:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.519s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:53:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-9f3687b0-9623-4148-a458-2ebadcc3d43b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c69a1fd-f35a-4d86-9a08-28140f29f43f', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:53:57 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-2eba4227-076e-414f-8ad3-37c9ce0d3d6c req-c7b50e91-1ead-41a1-bf0e-7bbabc032ba6 tempest-AttachVolumeTestJSON-984368886 None] attachment_update completed successfully. Jun 27 19:54:09 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=18,cinder:UPDATE=20,cinder:INSERT=1,cinder:DELETE=2 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:54:09 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=25,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:54:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Acquiring lock "cinder-cd39ed6e-92c1-4233-98f6-3f0342e62d04-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:54:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "cinder-cd39ed6e-92c1-4233-98f6-3f0342e62d04-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:54:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Acquiring lock "cinder-quobyte-cd39ed6e-92c1-4233-98f6-3f0342e62d04" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:54:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "cinder-quobyte-cd39ed6e-92c1-4233-98f6-3f0342e62d04" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:54:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbf3e12-f9d8-4a33-8539-d36fcd68bf82]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:54:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:11 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 Jun 27 19:54:11 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:12 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04" returned: 0 in 1.321s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:12 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04 Jun 27 19:54:12 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:13 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cd39ed6e-92c1-4233-98f6-3f0342e62d04" returned: 0 in 0.998s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "cinder-quobyte-cd39ed6e-92c1-4233-98f6-3f0342e62d04" released by "delete_volume" :: held 2.399s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:54:13 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Created reservations ['c77b9ef8-1179-4c34-a8ba-dae7918e63fb', '5e11aad2-bbf8-4cfd-af09-7547df7ab306', '0db464b1-4be7-4331-bc24-7b308baf441b', '7f626f67-a6cf-4538-8169-98b000ad6d32'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:54:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:54:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:54:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:14 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:54:14 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:15 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.177s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:15 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:54:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Deleted volume successfully. Jun 27 19:54:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fbdf6254-104b-47a7-bc4d-f5c14a64f3ac tempest-ServerRescueNegativeTestJSON-1539626822 None] Lock "cinder-cd39ed6e-92c1-4233-98f6-3f0342e62d04-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:16 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:54:16 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:17 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.273s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:54:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:54:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:54:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:54:24 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=3 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:54:25 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:54:42 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:54:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Flow 'volume_create_manager' (cd426c6d-7d10-4def-ba91-a986570ff696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:54:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf13c792-3861-400b-aab0-2f2c031ee151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf13c792-3861-400b-aab0-2f2c031ee151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-972644852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d153188f-9b7e-4450-bfe3-ef0f08cc19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2a6dcdb04c406a84524bcbb26330eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:54:43Z,use_quota=True,user_id='0c5cf673328b48098ff50d75b20c5fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4723359-07cf-492b-b340-4415b4f4a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4723359-07cf-492b-b340-4415b4f4a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94104c88-48ed-4c02-9353-3ff1a4f15b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94104c88-48ed-4c02-9353-3ff1a4f15b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd153188f-9b7e-4450-bfe3-ef0f08cc19aa', 'volume_name': 'volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ecd2c2-5d17-44ef-a676-8d9b5c4f28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ecd2c2-5d17-44ef-a676-8d9b5c4f28fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0bbaf2-b107-4fb9-a484-47ad885c39d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:43 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Volume d153188f-9b7e-4450-bfe3-ef0f08cc19aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa', 'volume_size': 1} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-972644852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d153188f-9b7e-4450-bfe3-ef0f08cc19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2a6dcdb04c406a84524bcbb26330eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:54:43Z,use_quota=True,user_id='0c5cf673328b48098ff50d75b20c5fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Creating volume d153188f-9b7e-4450-bfe3-ef0f08cc19aa {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:54:43 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:54:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:43 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa 1073741824 Jun 27 19:54:43 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:44 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa 1073741824" returned: 0 in 1.565s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:44 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa Jun 27 19:54:44 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:45 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" returned: 0 in 0.797s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0bbaf2-b107-4fb9-a484-47ad885c39d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023e5b5d-f958-46d4-9504-b03e226fb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Volume volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa (d153188f-9b7e-4450-bfe3-ef0f08cc19aa): created successfully Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023e5b5d-f958-46d4-9504-b03e226fb39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Flow 'volume_create_manager' (cd426c6d-7d10-4def-ba91-a986570ff696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:54:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8a068b3a-2a0f-4b4d-9083-ef8865c419e4 tempest-TaggedAttachmentsTest-335688102 None] Created volume successfully. Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Flow 'volume_create_manager' (89763bfc-5db3-4d26-a70b-bea375c3590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf362bc-bb90-4601-a9ee-66c44579cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf362bc-bb90-4601-a9ee-66c44579cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1214857628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85672d9-ff98-488f-a9ee-dd35d0f7be4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04badb80d4f416e89d6d23ba18ebc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:54:52Z,use_quota=True,user_id='f49e357b18a3456d964df0e307e9585e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bcb12d-2599-42fc-8a60-3e5a12c2e001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bcb12d-2599-42fc-8a60-3e5a12c2e001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0551d486-89c9-45f7-b5cb-2732def359f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0551d486-89c9-45f7-b5cb-2732def359f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85672d9-ff98-488f-a9ee-dd35d0f7be4c', 'volume_name': 'volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ceaa6c-d7a1-43d7-b994-e35cb7656c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ceaa6c-d7a1-43d7-b994-e35cb7656c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282179cd-764e-4ee0-95e3-dee16937cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Volume a85672d9-ff98-488f-a9ee-dd35d0f7be4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c', 'volume_size': 1} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1214857628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85672d9-ff98-488f-a9ee-dd35d0f7be4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04badb80d4f416e89d6d23ba18ebc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:54:52Z,use_quota=True,user_id='f49e357b18a3456d964df0e307e9585e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Creating volume a85672d9-ff98-488f-a9ee-dd35d0f7be4c {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:54:51 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:54:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:51 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c 1073741824 Jun 27 19:54:51 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:53 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c 1073741824" returned: 0 in 1.160s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:53 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c Jun 27 19:54:53 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:54 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c" returned: 0 in 1.229s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] <== create_volume: return (2455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282179cd-764e-4ee0-95e3-dee16937cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c602a057-82ac-4159-8803-0a1e9e12cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:54:54 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Volume volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c (a85672d9-ff98-488f-a9ee-dd35d0f7be4c): created successfully Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c602a057-82ac-4159-8803-0a1e9e12cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:54:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Flow 'volume_create_manager' (89763bfc-5db3-4d26-a70b-bea375c3590a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:54:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-47d3fd5b-95c3-4f5b-acc8-bdc4f3de9ff7 tempest-VolumesAdminNegativeTest-425589481 None] Created volume successfully. Jun 27 19:54:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Acquiring lock "cinder-a85672d9-ff98-488f-a9ee-dd35d0f7be4c-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:54:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Lock "cinder-a85672d9-ff98-488f-a9ee-dd35d0f7be4c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:54:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Acquiring lock "cinder-quobyte-a85672d9-ff98-488f-a9ee-dd35d0f7be4c" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:54:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Lock "cinder-quobyte-a85672d9-ff98-488f-a9ee-dd35d0f7be4c" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:54:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e710459-3569-4900-8102-13665f9d301c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:54:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:56 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c Jun 27 19:54:56 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:57 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c" returned: 0 in 1.325s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:57 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c Jun 27 19:54:57 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:54:58 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jun 27 19:54:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a85672d9-ff98-488f-a9ee-dd35d0f7be4c" returned: 0 in 1.083s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:54:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Lock "cinder-quobyte-a85672d9-ff98-488f-a9ee-dd35d0f7be4c" released by "delete_volume" :: held 2.459s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Created reservations ['92a8332d-51ee-483b-836e-17cdbbde50fd', 'f6c8e0a1-c954-4620-8b1a-718eb77a3ff1', 'b50d82d7-c0a9-4611-8c4c-dd5f61eac313', '05c09e79-8467-4a8d-866f-20f1063b7f1d'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:54:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:54:59 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:54:59 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:55:00 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jun 27 19:55:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.185s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:55:00 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:55:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Deleted volume successfully. Jun 27 19:55:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-21db4f2b-f3e8-403b-9e0f-e950466d1292 tempest-VolumesAdminNegativeTest-425589481 None] Lock "cinder-a85672d9-ff98-488f-a9ee-dd35d0f7be4c-delete_volume" released by "delete_volume" :: held 4.049s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:55:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-5d955000-b814-446a-9a16-85f04a2ef6bd req-66ff983f-7c49-4a29-889d-5d57fbb07f75 tempest-AttachVolumeTestJSON-984368886 None] Terminate volume connection completed successfully. Jun 27 19:55:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-5d955000-b814-446a-9a16-85f04a2ef6bd req-66ff983f-7c49-4a29-889d-5d57fbb07f75 tempest-AttachVolumeTestJSON-984368886 None] Deleting attachment 1c69a1fd-f35a-4d86-9a08-28140f29f43f. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:55:10 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:55:13 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=4 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:55:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:55:16 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:55:16 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:55:17 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jun 27 19:55:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.005s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:55:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Flow 'volume_create_manager' (4e2d559c-4c21-43b7-8a1c-bcb6d3fcdecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfc08df-3b84-47d5-a519-cd2548d7c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfc08df-3b84-47d5-a519-cd2548d7c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-181918925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0c3006-6615-4103-a9dc-42b38bf4449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee135d31504d33ad3909ed8319338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:55:51Z,use_quota=True,user_id='e430ceb5e2254b03bee67498ed744880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df508d7-df01-4e15-a0a5-af7ddb2ec151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df508d7-df01-4e15-a0a5-af7ddb2ec151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a428b5-87f4-4dbf-8651-9a301df6ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a428b5-87f4-4dbf-8651-9a301df6ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0c3006-6615-4103-a9dc-42b38bf4449e', 'volume_name': 'volume-8e0c3006-6615-4103-a9dc-42b38bf4449e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91556a-9a9d-4626-b204-04550d01172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91556a-9a9d-4626-b204-04550d01172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c731b77-11bd-44e2-8f8e-3ecaa94f1401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:55:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Volume 8e0c3006-6615-4103-a9dc-42b38bf4449e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0c3006-6615-4103-a9dc-42b38bf4449e', 'volume_size': 1} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-181918925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0c3006-6615-4103-a9dc-42b38bf4449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee135d31504d33ad3909ed8319338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:55:51Z,use_quota=True,user_id='e430ceb5e2254b03bee67498ed744880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Creating volume 8e0c3006-6615-4103-a9dc-42b38bf4449e {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:55:51 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:55:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:55:51 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e 1073741824 Jun 27 19:55:51 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:55:52 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e 1073741824" returned: 0 in 0.918s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:55:52 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e Jun 27 19:55:52 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:55:52 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e" returned: 0 in 0.631s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c731b77-11bd-44e2-8f8e-3ecaa94f1401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0c3006-6615-4103-a9dc-42b38bf4449e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13c38be-9b27-4bcb-bccb-e201ab7188ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:55:52 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Volume volume-8e0c3006-6615-4103-a9dc-42b38bf4449e (8e0c3006-6615-4103-a9dc-42b38bf4449e): created successfully Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13c38be-9b27-4bcb-bccb-e201ab7188ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:55:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Flow 'volume_create_manager' (4e2d559c-4c21-43b7-8a1c-bcb6d3fcdecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:55:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3f158976-c53c-4444-9064-6a9bbcf914b4 tempest-AttachVolumeNegativeTest-709673990 None] Created volume successfully. Jun 27 19:55:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:55:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:55:53 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38ea869-b546-4ed2-bc18-6b76ffae50a5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:55:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:55:53 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa Jun 27 19:55:53 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:55:54 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jun 27 19:55:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" returned: 0 in 0.819s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:55:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.841s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:55:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4afdd451-d633-41aa-9a57-94dfa2ff2c77', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:55:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-1a56ed7c-2143-46ff-a26e-28382088adf4 req-7a0d5c89-4a85-419f-b04d-8c13c0a82218 tempest-TaggedAttachmentsTest-335688102 None] attachment_update completed successfully. Jun 27 19:55:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:55:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:55:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f69e4b6-692e-4725-8b5a-d1e4e046f4f4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:55:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:55:56 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e Jun 27 19:55:56 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:55:57 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jun 27 19:55:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e" returned: 0 in 1.069s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:55:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.094s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:55:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-8e0c3006-6615-4103-a9dc-42b38bf4449e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51b780ff-fe58-4e4c-bc8e-2567f0d35468', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:55:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-95c9eed4-3abf-43f2-a92e-5e453f2cc688 req-45ab828f-7c1d-45cc-920f-ba45dd2546ea tempest-AttachVolumeNegativeTest-709673990 None] attachment_update completed successfully. Jun 27 19:56:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-eee55948-5262-4cf3-9e63-ea712af10193 req-8371116e-4335-4a51-811e-78e4b98918cc tempest-TaggedAttachmentsTest-335688102 None] Terminate volume connection completed successfully. Jun 27 19:56:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-eee55948-5262-4cf3-9e63-ea712af10193 req-8371116e-4335-4a51-811e-78e4b98918cc tempest-TaggedAttachmentsTest-335688102 None] Deleting attachment 4afdd451-d633-41aa-9a57-94dfa2ff2c77. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:56:12 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=6,cinder:SELECT=12,cinder:INSERT=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:56:12 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=17,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:16 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:56:16 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:17 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.528s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:56:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:56:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:56:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:56:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Acquiring lock "cinder-d153188f-9b7e-4450-bfe3-ef0f08cc19aa-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:56:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Lock "cinder-d153188f-9b7e-4450-bfe3-ef0f08cc19aa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:56:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Acquiring lock "cinder-quobyte-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:56:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Lock "cinder-quobyte-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:56:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3e37d-54c7-4d7b-be9c-951642d3c92c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:56:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:28 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa Jun 27 19:56:28 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:28 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" returned: 0 in 0.905s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:29 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa Jun 27 19:56:29 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Flow 'volume_create_manager' (6e0eb72a-fe12-450b-8159-205df6f490cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee76ac98-47f3-49ba-ab41-d1962e7ae127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee76ac98-47f3-49ba-ab41-d1962e7ae127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-813891962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8911e33d-b210-423a-b763-e564cf934167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24502c606da4bc8a7daba30e58938ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:30Z,use_quota=True,user_id='619b15a3803e4521b63894e41a57445a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a53f1c4-1cca-4529-97df-a13f2fdebb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a53f1c4-1cca-4529-97df-a13f2fdebb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a034a677-2c1a-46c6-98fa-1a3f1bef4eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a034a677-2c1a-46c6-98fa-1a3f1bef4eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8911e33d-b210-423a-b763-e564cf934167', 'volume_name': 'volume-8911e33d-b210-423a-b763-e564cf934167', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8403add-83e1-4510-85c7-4b97e14bbc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8403add-83e1-4510-85c7-4b97e14bbc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f218e4-d68e-4da5-95f7-bd5dc11ec42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:30 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Volume 8911e33d-b210-423a-b763-e564cf934167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8911e33d-b210-423a-b763-e564cf934167', 'volume_size': 1} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-813891962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8911e33d-b210-423a-b763-e564cf934167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24502c606da4bc8a7daba30e58938ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:30Z,use_quota=True,user_id='619b15a3803e4521b63894e41a57445a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Creating volume 8911e33d-b210-423a-b763-e564cf934167 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:56:30 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:30 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 1073741824 Jun 27 19:56:30 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:30 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" returned: 0 in 1.405s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Lock "cinder-quobyte-d153188f-9b7e-4450-bfe3-ef0f08cc19aa" released by "delete_volume" :: held 2.378s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Created reservations ['3f4164cf-86b7-4996-b6d2-ca69fad808fb', '053a90af-22af-427a-911b-a1fc501a1650', '1cde09b8-1380-4fdc-a6cc-2ff9abdddad7', '67028ee8-a1ce-4136-89f0-dea1c3548b13'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:30 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:56:30 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:31 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 1073741824" returned: 0 in 1.443s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:31 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.281s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:31 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:56:31 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 Jun 27 19:56:31 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Deleted volume successfully. Jun 27 19:56:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e242d09d-e8ba-4c20-a9c4-6e5d298afe62 tempest-TaggedAttachmentsTest-335688102 None] Lock "cinder-d153188f-9b7e-4450-bfe3-ef0f08cc19aa-delete_volume" released by "delete_volume" :: held 4.025s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:56:33 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167" returned: 0 in 1.407s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] <== create_volume: return (2935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.939s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f218e4-d68e-4da5-95f7-bd5dc11ec42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8911e33d-b210-423a-b763-e564cf934167', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee16708-84ba-4bc1-80c7-b5fa7cc08f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:33 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Volume volume-8911e33d-b210-423a-b763-e564cf934167 (8911e33d-b210-423a-b763-e564cf934167): created successfully Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee16708-84ba-4bc1-80c7-b5fa7cc08f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Flow 'volume_create_manager' (6e0eb72a-fe12-450b-8159-205df6f490cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-34b54898-3632-4ffb-a7e9-5fbb7399e2e2 tempest-ServersNegativeTestJSON-1434605201 None] Created volume successfully. Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Flow 'volume_create_manager' (9f498a03-2a10-499b-9958-ca17ddea6081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ebc822-cd7c-4cf4-9456-f24791ba2f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ebc822-cd7c-4cf4-9456-f24791ba2f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1493398870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b807c6a4-8ddf-48b7-9147-05b6a8495a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24502c606da4bc8a7daba30e58938ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:35Z,use_quota=True,user_id='619b15a3803e4521b63894e41a57445a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb26c9e4-4973-403d-845f-d40fd77ece9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb26c9e4-4973-403d-845f-d40fd77ece9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae3ae1c-fd44-4e00-8496-b5d3b18caac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae3ae1c-fd44-4e00-8496-b5d3b18caac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b807c6a4-8ddf-48b7-9147-05b6a8495a69', 'volume_name': 'volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f9b402-3468-4041-a336-10bfb6165ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f9b402-3468-4041-a336-10bfb6165ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2eccb8-7e84-4fef-a91a-3564f3b14a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:35 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Volume b807c6a4-8ddf-48b7-9147-05b6a8495a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69', 'volume_size': 1} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1493398870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b807c6a4-8ddf-48b7-9147-05b6a8495a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24502c606da4bc8a7daba30e58938ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:35Z,use_quota=True,user_id='619b15a3803e4521b63894e41a57445a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Creating volume b807c6a4-8ddf-48b7-9147-05b6a8495a69 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:56:35 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:56:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:35 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 1073741824 Jun 27 19:56:35 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:36 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 1073741824" returned: 0 in 1.149s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:36 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 Jun 27 19:56:36 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:37 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69" returned: 0 in 0.793s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2eccb8-7e84-4fef-a91a-3564f3b14a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1139e4a0-a13a-463b-b1c5-6d7e56e82ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:37 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Volume volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 (b807c6a4-8ddf-48b7-9147-05b6a8495a69): created successfully Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1139e4a0-a13a-463b-b1c5-6d7e56e82ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Flow 'volume_create_manager' (9f498a03-2a10-499b-9958-ca17ddea6081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-195f39c2-962c-4763-b545-42e55821f2f7 tempest-ServersNegativeTestJSON-1434605201 None] Created volume successfully. Jun 27 19:56:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "cinder-b807c6a4-8ddf-48b7-9147-05b6a8495a69-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:56:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-b807c6a4-8ddf-48b7-9147-05b6a8495a69-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:56:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "cinder-quobyte-b807c6a4-8ddf-48b7-9147-05b6a8495a69" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:56:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-quobyte-b807c6a4-8ddf-48b7-9147-05b6a8495a69" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:56:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbcad10-977c-4983-8b58-4b96eddcbc24]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:56:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:39 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 Jun 27 19:56:39 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:39 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69" returned: 0 in 1.009s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:40 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69 Jun 27 19:56:40 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:41 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b807c6a4-8ddf-48b7-9147-05b6a8495a69" returned: 0 in 1.270s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-quobyte-b807c6a4-8ddf-48b7-9147-05b6a8495a69" released by "delete_volume" :: held 2.403s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Created reservations ['d2bff400-4422-4daf-ae8c-8018541aac67', '22cfdb94-fa83-4c78-a8af-339bd9dfc0db', 'efff3097-2ca0-4398-8a87-339b03885ee3', '8adbb944-ab55-4f2f-99ad-91ed0e10fb96'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:41 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:56:41 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "cinder-8911e33d-b210-423a-b763-e564cf934167-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-8911e33d-b210-423a-b763-e564cf934167-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "cinder-quobyte-8911e33d-b210-423a-b763-e564cf934167" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-quobyte-8911e33d-b210-423a-b763-e564cf934167" acquired by "delete_volume" :: waited 0.046s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7716fa0e-598e-45a2-a7a9-0ff63d016a26]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:42 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.061s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:56:42 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 Jun 27 19:56:42 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Deleted volume successfully. Jun 27 19:56:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a1c8f7d-4b19-425d-b54f-28fcce220b8b tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-b807c6a4-8ddf-48b7-9147-05b6a8495a69-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:56:43 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167" returned: 0 in 0.869s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:43 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167 Jun 27 19:56:43 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:44 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8911e33d-b210-423a-b763-e564cf934167" returned: 0 in 0.689s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-quobyte-8911e33d-b210-423a-b763-e564cf934167" released by "delete_volume" :: held 1.634s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Created reservations ['3c6b91e9-e9eb-498e-860b-55a64413ff11', '91d17a07-01c1-4466-9982-ec74459c761a', '154ae200-1756-42f2-b84a-d0a2b95e706b', '15330974-4ade-4ab0-8a97-59ce15f0105f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:44 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:56:44 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:44 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.748s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:44 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:56:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Deleted volume successfully. Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1abf5ea2-39b9-47ae-9710-8521098d673d tempest-ServersNegativeTestJSON-1434605201 None] Lock "cinder-8911e33d-b210-423a-b763-e564cf934167-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Flow 'volume_create_manager' (e8613aa8-96d7-44fe-a7bd-2876eb6626de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41911924-0320-4ddd-b159-5c0e55709280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41911924-0320-4ddd-b159-5c0e55709280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1526660460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b3d517de684d8c82788dabe0a3a991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:45Z,use_quota=True,user_id='7e89ea9c87bf4ac88bb3b40b447e1920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1266071d-4794-472c-8547-ab9d5aaa5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1266071d-4794-472c-8547-ab9d5aaa5488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fae2c0-e35c-4cc2-a0dd-1e7032f23e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fae2c0-e35c-4cc2-a0dd-1e7032f23e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff', 'volume_name': 'volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e46795-2e13-4204-a071-f7b96d73d364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e46795-2e13-4204-a071-f7b96d73d364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa98ef1-a4b5-4a11-bc34-56dea43efb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Volume 0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff', 'volume_size': 1} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1526660460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b3d517de684d8c82788dabe0a3a991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:45Z,use_quota=True,user_id='7e89ea9c87bf4ac88bb3b40b447e1920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Creating volume 0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:56:45 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:56:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:45 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff 1073741824 Jun 27 19:56:45 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:46 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff 1073741824" returned: 0 in 1.062s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:46 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff Jun 27 19:56:46 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:47 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" returned: 0 in 0.838s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa98ef1-a4b5-4a11-bc34-56dea43efb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1134b7-5cb3-424b-a456-372dfa857358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:47 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Volume volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff (0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff): created successfully Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1134b7-5cb3-424b-a456-372dfa857358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Flow 'volume_create_manager' (e8613aa8-96d7-44fe-a7bd-2876eb6626de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-22e209eb-5c9a-412b-85d9-567fcf45cd17 tempest-AttachVolumeTestJSON-984368886 None] Created volume successfully. Jun 27 19:56:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641ffb1-5ae3-4c60-ad81-1307bf73c955]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:56:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:51 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff Jun 27 19:56:51 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:52 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" returned: 0 in 0.955s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.991s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89621596-9c75-4f70-b4ad-c51554aa5062', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:56:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-0382f8d3-d7e0-4510-9238-01e64efa09de req-cf972adf-f5d7-47ce-86c1-e9dd04ab4329 tempest-AttachVolumeTestJSON-984368886 None] attachment_update completed successfully. Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Flow 'volume_create_manager' (15d3113b-c42a-48d3-b61b-8d40653d8868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4379ef-70fd-4f4a-8e46-3259e7500349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4379ef-70fd-4f4a-8e46-3259e7500349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-399928395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee290e5-5273-48c2-bb30-e9c345fd1dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b3d517de684d8c82788dabe0a3a991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:59Z,use_quota=True,user_id='7e89ea9c87bf4ac88bb3b40b447e1920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc1b9a6-4d03-4757-920f-f8cd72ea9203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc1b9a6-4d03-4757-920f-f8cd72ea9203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f4910b-270f-49ac-95c7-0a9d3d3c19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f4910b-270f-49ac-95c7-0a9d3d3c19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee290e5-5273-48c2-bb30-e9c345fd1dc1', 'volume_name': 'volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48910cc-d395-43b0-8b00-cbe5c7c83c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48910cc-d395-43b0-8b00-cbe5c7c83c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7652eedf-c802-4251-a975-cb4307f53c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:56:58 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Volume 5ee290e5-5273-48c2-bb30-e9c345fd1dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1', 'volume_size': 1} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-399928395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee290e5-5273-48c2-bb30-e9c345fd1dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b3d517de684d8c82788dabe0a3a991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:56:59Z,use_quota=True,user_id='7e89ea9c87bf4ac88bb3b40b447e1920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Creating volume 5ee290e5-5273-48c2-bb30-e9c345fd1dc1 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:56:58 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:56:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:58 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 1073741824 Jun 27 19:56:58 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:56:59 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jun 27 19:56:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 1073741824" returned: 0 in 1.105s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:56:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:56:59 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 Jun 27 19:56:59 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:00 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" returned: 0 in 0.876s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7652eedf-c802-4251-a975-cb4307f53c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeaefc4-562e-4187-b62d-faabc3015d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:00 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Volume volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 (5ee290e5-5273-48c2-bb30-e9c345fd1dc1): created successfully Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeaefc4-562e-4187-b62d-faabc3015d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Flow 'volume_create_manager' (15d3113b-c42a-48d3-b61b-8d40653d8868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:57:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d8340bdf-db23-472b-943c-4c0e7cbc692f tempest-AttachVolumeTestJSON-984368886 None] Created volume successfully. Jun 27 19:57:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:05 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e734b9-f205-4153-b6f7-dbf8134c9aa6]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:57:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:05 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 Jun 27 19:57:05 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-66932f02-e9f3-4b61-9bbc-c11da2b07a43 req-bd75c3d5-8f1f-4c35-ae50-6b9533195c95 tempest-AttachVolumeNegativeTest-709673990 None] Terminate volume connection completed successfully. Jun 27 19:57:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-66932f02-e9f3-4b61-9bbc-c11da2b07a43 req-bd75c3d5-8f1f-4c35-ae50-6b9533195c95 tempest-AttachVolumeNegativeTest-709673990 None] Deleting attachment 51b780ff-fe58-4e4c-bc8e-2567f0d35468. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:57:06 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" returned: 0 in 0.876s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1802d1d0-8def-4455-9dde-088dd1458133', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:57:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-55ad4d54-8bdf-44b0-9131-a3a3116e39dd req-907a71f9-ee7b-472e-8c59-bb208d8c5fa9 tempest-AttachVolumeTestJSON-984368886 None] attachment_update completed successfully. Jun 27 19:57:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-0b54517d-c642-40de-81e0-3a89ed985ae7 req-044d29ab-7792-4b06-8f2b-62d9f3649b32 tempest-AttachVolumeTestJSON-984368886 None] Terminate volume connection completed successfully. Jun 27 19:57:13 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-0b54517d-c642-40de-81e0-3a89ed985ae7 req-044d29ab-7792-4b06-8f2b-62d9f3649b32 tempest-AttachVolumeTestJSON-984368886 None] Deleting attachment 89621596-9c75-4f70-b4ad-c51554aa5062. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:16 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:57:16 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:16 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-1bc1d269-a285-4e1a-9eb3-680a7999af18 req-44539fd8-fab8-484f-8c7b-081fe4b272bb tempest-AttachVolumeTestJSON-984368886 None] Terminate volume connection completed successfully. Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-1bc1d269-a285-4e1a-9eb3-680a7999af18 req-44539fd8-fab8-484f-8c7b-081fe4b272bb tempest-AttachVolumeTestJSON-984368886 None] Deleting attachment 1802d1d0-8def-4455-9dde-088dd1458133. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:57:16 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.718s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:57:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:57:26 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=42,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:57:26 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=38,cinder:SELECT=32,cinder:INSERT=9,cinder:DELETE=5 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:57:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "cinder-5ee290e5-5273-48c2-bb30-e9c345fd1dc1-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:57:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-5ee290e5-5273-48c2-bb30-e9c345fd1dc1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:57:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "cinder-quobyte-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:57:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-quobyte-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" acquired by "delete_volume" :: waited 0.048s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:57:30 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[394071de-341f-41a8-9115-0e68e8b588e0]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:57:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:31 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 Jun 27 19:57:31 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:32 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" returned: 0 in 1.685s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:32 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1 Jun 27 19:57:32 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:33 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" returned: 0 in 1.101s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-quobyte-5ee290e5-5273-48c2-bb30-e9c345fd1dc1" released by "delete_volume" :: held 2.894s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:57:33 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Created reservations ['663aa75a-a1ac-4502-b7f3-b7451f6cca9a', '10de9cc4-380e-4669-a729-c1a21ce1ed93', '0a0853f8-100f-4b50-8f37-520abd0f0ed9', '7eb1e5c9-eca5-436f-81f5-97f470c908e1'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:34 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:57:34 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "cinder-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "cinder-quobyte-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-quobyte-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8a731-fcce-4cad-8a21-76cba34ba987]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:57:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:34 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff Jun 27 19:57:34 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:35 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.342s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:35 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:57:35 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Deleted volume successfully. Jun 27 19:57:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-33e75b6a-c1f5-4ac9-91fc-b678a084882c tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-5ee290e5-5273-48c2-bb30-e9c345fd1dc1-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:57:35 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" returned: 0 in 1.175s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:35 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff Jun 27 19:57:35 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:36 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" returned: 0 in 0.855s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-quobyte-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff" released by "delete_volume" :: held 2.092s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Created reservations ['c9aa007c-256f-4cca-bebb-08f121c204f1', 'ab1c11f4-d851-48b1-932e-f08b029e4327', 'c0a065af-6f69-42ea-9894-c689a8e31818', 'e5d5b2c0-a170-4fe0-add3-5f728de048ea'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:36 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:57:36 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:37 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.712s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:57:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Deleted volume successfully. Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8cd5e851-fe9a-4e25-80a0-d4ae655d60e1 tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-0bb8e83d-ca28-44a7-9e6e-7bfe74b1aeff-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "cinder-9f3687b0-9623-4148-a458-2ebadcc3d43b-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-9f3687b0-9623-4148-a458-2ebadcc3d43b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "cinder-quobyte-9f3687b0-9623-4148-a458-2ebadcc3d43b" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:57:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-quobyte-9f3687b0-9623-4148-a458-2ebadcc3d43b" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:57:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a745d5-15b2-4820-a9df-b207d2dca75c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:57:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:38 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b Jun 27 19:57:38 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:38 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b" returned: 0 in 0.873s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:38 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b Jun 27 19:57:38 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:39 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9f3687b0-9623-4148-a458-2ebadcc3d43b" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-quobyte-9f3687b0-9623-4148-a458-2ebadcc3d43b" released by "delete_volume" :: held 1.590s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Created reservations ['fa27dea0-6227-4395-8e12-56e414f5af9e', '979f9e05-1e1a-49b9-84e0-6c148993cdcc', '8532fac2-5f73-45c5-b97d-3f7a552d857c', '4c366d24-d4a9-4054-8bc3-6dc18f1dfb58'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:39 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:57:39 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:40 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.753s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:40 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:57:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Deleted volume successfully. Jun 27 19:57:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af72eba4-748b-4895-8d2c-36de8ceae06e tempest-AttachVolumeTestJSON-984368886 None] Lock "cinder-9f3687b0-9623-4148-a458-2ebadcc3d43b-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Flow 'volume_create_manager' (c258941f-9050-4b4f-8401-217efe54e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6d7b98-59ac-4837-ab06-0f07df1fd0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6d7b98-59ac-4837-ab06-0f07df1fd0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-439508096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c31829-f629-4bb6-b225-88598049b434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86514d7c73fb4a489d1dc889b8eaba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:57:47Z,use_quota=True,user_id='154f4dc651ec488d9c40cb60442710ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8db854a-120f-4ee8-a8c1-260d9ebc1b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8db854a-120f-4ee8-a8c1-260d9ebc1b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa77a44f-c1d4-4b84-8590-66ed341e534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa77a44f-c1d4-4b84-8590-66ed341e534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c31829-f629-4bb6-b225-88598049b434', 'volume_name': 'volume-27c31829-f629-4bb6-b225-88598049b434', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68eff6d-deb7-4d02-b037-27e969b29c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68eff6d-deb7-4d02-b037-27e969b29c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad954ae-9e8e-48b6-81d9-4d626bf4eff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:47 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Volume 27c31829-f629-4bb6-b225-88598049b434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c31829-f629-4bb6-b225-88598049b434', 'volume_size': 1} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-439508096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c31829-f629-4bb6-b225-88598049b434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86514d7c73fb4a489d1dc889b8eaba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:57:47Z,use_quota=True,user_id='154f4dc651ec488d9c40cb60442710ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Creating volume 27c31829-f629-4bb6-b225-88598049b434 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:57:47 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:57:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:47 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 1073741824 Jun 27 19:57:47 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:48 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 1073741824" returned: 0 in 1.320s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:48 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 Jun 27 19:57:48 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:50 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434" returned: 0 in 1.111s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad954ae-9e8e-48b6-81d9-4d626bf4eff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c31829-f629-4bb6-b225-88598049b434', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b16d54c-a6b0-453a-91b9-1014f2825a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:50 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Volume volume-27c31829-f629-4bb6-b225-88598049b434 (27c31829-f629-4bb6-b225-88598049b434): created successfully Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b16d54c-a6b0-453a-91b9-1014f2825a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Flow 'volume_create_manager' (c258941f-9050-4b4f-8401-217efe54e710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:57:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-22c39da2-98c3-42fe-a3dd-a464a1d9d6aa tempest-ServerActionsTestOtherA-1089043092 None] Created volume successfully. Jun 27 19:57:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ef61d619-ed71-4e4c-a320-9588b227c08e tempest-BackendsCapabilitiesAdminTestsJSON-822460163 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.683692932129, 'free_capacity_gb': 1775.683692932129, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93503) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 27 19:57:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8ab41687-d17f-4aad-860c-9d1a38a79e21 tempest-BackendsCapabilitiesAdminTestsJSON-822460163 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.683692932129, 'free_capacity_gb': 1775.683692932129, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93503) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Flow 'volume_create_manager' (9f7955d2-a317-4e70-af3a-caba1f18e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d0935f-c86b-4d5e-a99e-256b934a3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d0935f-c86b-4d5e-a99e-256b934a3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1417725642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aaf734-3581-4a69-9b65-cbeb3e0094b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae719dc76d854c6894075f6ef9f543dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:57:57Z,use_quota=True,user_id='52eac49eab5541dba3d9d5e7545eb634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5b4078-9870-42df-a72f-e68957c3ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5b4078-9870-42df-a72f-e68957c3ca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f81f89-93f5-4b4c-a752-c5d253542d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f81f89-93f5-4b4c-a752-c5d253542d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47aaf734-3581-4a69-9b65-cbeb3e0094b7', 'volume_name': 'volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df6f3f4-d0f5-4fcb-8d0e-aa89b384c384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df6f3f4-d0f5-4fcb-8d0e-aa89b384c384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df858db9-24af-465e-95ee-a5df23785c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Volume 47aaf734-3581-4a69-9b65-cbeb3e0094b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7', 'volume_size': 1} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1417725642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aaf734-3581-4a69-9b65-cbeb3e0094b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae719dc76d854c6894075f6ef9f543dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:57:57Z,use_quota=True,user_id='52eac49eab5541dba3d9d5e7545eb634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Creating volume 47aaf734-3581-4a69-9b65-cbeb3e0094b7 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:57:57 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:57:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:57 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 1073741824 Jun 27 19:57:57 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:58 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 1073741824" returned: 0 in 1.120s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:57:58 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 Jun 27 19:57:58 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:57:59 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7" returned: 0 in 0.931s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df858db9-24af-465e-95ee-a5df23785c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b369c3-050f-4bbb-bd9f-2a73c5b5e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:57:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Volume volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 (47aaf734-3581-4a69-9b65-cbeb3e0094b7): created successfully Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b369c3-050f-4bbb-bd9f-2a73c5b5e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:57:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Flow 'volume_create_manager' (9f7955d2-a317-4e70-af3a-caba1f18e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:57:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d9e3ca7f-df61-4e3d-92fe-e8a2d387a1d8 tempest-AttachVolumeShelveTestJSON-684709757 None] Created volume successfully. Jun 27 19:58:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-91b754d3-0625-4f5b-958f-93631cc86f22 tempest-GroupsV320Test-113310008 None] Group tempest-GroupsV320Test-Group-1547043160: creating Jun 27 19:58:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-91b754d3-0625-4f5b-958f-93631cc86f22 tempest-GroupsV320Test-113310008 None] Group tempest-GroupsV320Test-Group-1547043160: created successfully Jun 27 19:58:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-91b754d3-0625-4f5b-958f-93631cc86f22 tempest-GroupsV320Test-113310008 None] Create group completed successfully. Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Created reservations ['9ca7cbb9-4011-490b-b972-7c7403c5e0c1'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:08 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:58:08 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Flow 'volume_create_manager' (9b717f21-da87-4d16-8717-fe26d2bd61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bf42be-5e60-4bae-81c1-e05398732da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bf42be-5e60-4bae-81c1-e05398732da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-240776461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942be50d-d96d-4e57-8e5a-c641d60777e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee135d31504d33ad3909ed8319338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:58:09Z,use_quota=True,user_id='e430ceb5e2254b03bee67498ed744880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d2c78b-4922-499d-99c9-f2ea6e568d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d2c78b-4922-499d-99c9-f2ea6e568d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e62926d-4f24-4789-afdb-93cc0f0a45b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e62926d-4f24-4789-afdb-93cc0f0a45b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942be50d-d96d-4e57-8e5a-c641d60777e4', 'volume_name': 'volume-942be50d-d96d-4e57-8e5a-c641d60777e4', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bf7e6a-ef9d-4f38-9d85-e0616b137795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bf7e6a-ef9d-4f38-9d85-e0616b137795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2223f001-e351-4853-b36b-5d0a6a18943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:09 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Volume 942be50d-d96d-4e57-8e5a-c641d60777e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942be50d-d96d-4e57-8e5a-c641d60777e4', 'volume_size': 1} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-240776461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942be50d-d96d-4e57-8e5a-c641d60777e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee135d31504d33ad3909ed8319338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:58:09Z,use_quota=True,user_id='e430ceb5e2254b03bee67498ed744880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Creating volume 942be50d-d96d-4e57-8e5a-c641d60777e4 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:58:09 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:09 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 1073741824 Jun 27 19:58:09 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:09 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.217s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:09 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:58:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-32a7ce98-6260-4bab-bce7-15d708e0277a tempest-GroupsV320Test-113310008 None] Delete group completed successfully. Jun 27 19:58:10 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 1073741824" returned: 0 in 1.611s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:11 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 Jun 27 19:58:11 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:12 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4" returned: 0 in 1.010s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] <== create_volume: return (2719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.723s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2223f001-e351-4853-b36b-5d0a6a18943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942be50d-d96d-4e57-8e5a-c641d60777e4', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b322b85e-aa6e-41f2-b79c-ab9e87bfe70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:12 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Volume volume-942be50d-d96d-4e57-8e5a-c641d60777e4 (942be50d-d96d-4e57-8e5a-c641d60777e4): created successfully Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b322b85e-aa6e-41f2-b79c-ab9e87bfe70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Flow 'volume_create_manager' (9b717f21-da87-4d16-8717-fe26d2bd61b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:58:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a0ebb832-15a4-45a7-bb27-7fe441f18cc5 tempest-AttachVolumeNegativeTest-709673990 None] Created volume successfully. Jun 27 19:58:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:15 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f65fcb-9258-4501-9e8e-8a87071fcb77]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:58:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:16 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 Jun 27 19:58:16 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:16 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:58:16 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:16 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4" returned: 0 in 1.067s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.113s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-942be50d-d96d-4e57-8e5a-c641d60777e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b780b0d1-95e2-4025-82f7-ea0e01687d2e', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:58:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-e0fb762d-696d-4ae5-a38c-5d91cf645a7f req-ea182e87-f3bb-4ddb-8bd1-39b342c11c55 tempest-AttachVolumeNegativeTest-709673990 None] attachment_update completed successfully. Jun 27 19:58:17 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.188s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:58:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:58:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:58:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:58:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-62194c14-8db7-4de0-a319-6d0ac744f485 req-b0806f12-d84c-47d9-934b-bf1c67277e1c tempest-AttachVolumeShelveTestJSON-684709757 None] No connector for attachment 1670eff4-0fdd-4960-8b50-74b2ab0e476d; skipping storage backend terminate_connection call. {{(pid=93503) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 27 19:58:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-62194c14-8db7-4de0-a319-6d0ac744f485 req-b0806f12-d84c-47d9-934b-bf1c67277e1c tempest-AttachVolumeShelveTestJSON-684709757 None] Deleting attachment 1670eff4-0fdd-4960-8b50-74b2ab0e476d. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:58:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-ef854744-4d06-449a-8efa-b7e7eed7d78e req-6e492359-f51e-4275-b660-51a0a5f56f72 tempest-AttachVolumeNegativeTest-709673990 None] Terminate volume connection completed successfully. Jun 27 19:58:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-ef854744-4d06-449a-8efa-b7e7eed7d78e req-6e492359-f51e-4275-b660-51a0a5f56f72 tempest-AttachVolumeNegativeTest-709673990 None] Deleting attachment b780b0d1-95e2-4025-82f7-ea0e01687d2e. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:58:33 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=38,cinder:INSERT=8,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=33,cinder:SELECT=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Flow 'volume_create_manager' (ac426359-f0fc-49c6-8665-2c1577cfd76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cac6bf-ba23-4400-be4e-4eb98165a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cac6bf-ba23-4400-be4e-4eb98165a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-109755854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a77c55-c4b2-4340-92b3-9fe2fe9177c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea267ab067b495690b5d6456ccc7e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:58:34Z,use_quota=True,user_id='c8e1dc95e342490d82c90e050ccf4e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdfec35-e580-4668-89b8-1e10f292ac8c),volume_type_id=4fdfec35-e580-4668-89b8-1e10f292ac8c)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1437147-05a2-4c40-a889-3e394800d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1437147-05a2-4c40-a889-3e394800d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7292596-6f4c-467c-a2ae-8faae0afd10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7292596-6f4c-467c-a2ae-8faae0afd10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a77c55-c4b2-4340-92b3-9fe2fe9177c1', 'volume_name': 'volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0882543c-7bab-4ba6-8db3-339a6675fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0882543c-7bab-4ba6-8db3-339a6675fa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb19866-5848-4994-925b-820e0768eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Volume d7a77c55-c4b2-4340-92b3-9fe2fe9177c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1', 'volume_size': 1} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-109755854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a77c55-c4b2-4340-92b3-9fe2fe9177c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea267ab067b495690b5d6456ccc7e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:58:34Z,use_quota=True,user_id='c8e1dc95e342490d82c90e050ccf4e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdfec35-e580-4668-89b8-1e10f292ac8c),volume_type_id=4fdfec35-e580-4668-89b8-1e10f292ac8c)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Creating volume d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:58:34 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:58:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:34 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 1073741824 Jun 27 19:58:34 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:35 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 1073741824" returned: 0 in 1.027s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:35 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 Jun 27 19:58:35 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:35 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1" returned: 0 in 0.746s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.320s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb19866-5848-4994-925b-820e0768eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9c1403-d27a-4287-8b54-16579e79bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebea0b3-f5a8-4bb4-9355-82e3addf6a97]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:58:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:36 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Volume volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 (d7a77c55-c4b2-4340-92b3-9fe2fe9177c1): created successfully Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9c1403-d27a-4287-8b54-16579e79bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Flow 'volume_create_manager' (ac426359-f0fc-49c6-8665-2c1577cfd76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:58:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-367bd89d-b823-4af8-9263-9f7e6bb5015d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Created volume successfully. Jun 27 19:58:36 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 Jun 27 19:58:36 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:36 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:58:36 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:36 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434" returned: 0 in 0.999s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.037s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-27c31829-f629-4bb6-b225-88598049b434', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '825e967c-b8d6-48c5-bc6a-5aa2971d673d', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:58:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-392b627b-e3c0-4747-8d46-a2bcb6a3b189 req-916f8a80-7d02-40e0-ad27-c4e5df5bd2f5 tempest-ServerActionsTestOtherA-1089043092 None] attachment_update completed successfully. Jun 27 19:58:37 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.802s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:58:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f600f975-3994-4a72-8098-7ce92fdd8e1d tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Retype volume completed successfully. Jun 27 19:58:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Acquiring lock "cinder-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:58:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "cinder-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:58:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Acquiring lock "cinder-quobyte-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:58:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "cinder-quobyte-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:58:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2788b5d1-dff0-487e-87e0-ff22bd7408e1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:58:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:38 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 Jun 27 19:58:38 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:38 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1" returned: 0 in 0.880s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:39 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1 Jun 27 19:58:39 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:39 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1" returned: 0 in 0.984s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "cinder-quobyte-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1" released by "delete_volume" :: held 1.929s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:58:40 devstack cinder-volume[93503]: WARNING cinder.quota [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 27 19:58:40 devstack cinder-volume[93503]: WARNING cinder.quota [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Created reservations ['6c4bdf6f-5789-40e4-95b6-16ee26713fe3', 'd1b91902-c0cb-47e3-88fd-d22b77e8aafa', 'a68be5cc-5b4f-45fa-a541-b50e611f517f', 'c6f0bc52-2106-4ed4-ab9c-80722ed3f031'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:40 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:58:40 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:41 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.063s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:41 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:58:41 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Deleted volume successfully. Jun 27 19:58:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add43059-51ed-4569-a118-b755354efab4 tempest-VolumeRetypeWithoutMigrationTest-1915116330 None] Lock "cinder-d7a77c55-c4b2-4340-92b3-9fe2fe9177c1-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:58:46 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-c88054a7-0270-4aec-a25b-d95bff1bd28d tempest-ServerActionsTestOtherA-1089043092 None] Terminate volume connection completed successfully. Jun 27 19:58:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-c88054a7-0270-4aec-a25b-d95bff1bd28d tempest-ServerActionsTestOtherA-1089043092 None] Deleting attachment 825e967c-b8d6-48c5-bc6a-5aa2971d673d. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:58:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:48 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2905aad-180c-4d51-9cd8-b88f8362eb02]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:58:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:49 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 Jun 27 19:58:49 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:58:50 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jun 27 19:58:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434" returned: 0 in 1.257s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:58:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.287s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-27c31829-f629-4bb6-b225-88598049b434', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8467b39c-72fb-4c8b-8d78-38c056865d4e', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:58:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-deac028e-c625-43c7-8d35-85e4eee718c5 req-d1c9e6d0-e8a8-4eba-bf00-a4bb86959ad0 tempest-ServerActionsTestOtherA-1089043092 None] attachment_update completed successfully. Jun 27 19:58:58 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Flow 'volume_create_manager' (70798729-117c-4863-8268-9b13d13afda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b562d5-f5d0-444d-a139-3d108903cd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b562d5-f5d0-444d-a139-3d108903cd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726003284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c690a71a1d6c44bc9905cac32859e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:58:59Z,use_quota=True,user_id='e9902189aef249c69a004d504cac56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bfb09a-720b-4d5f-8df8-aafebc2fc02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bfb09a-720b-4d5f-8df8-aafebc2fc02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270711be-0e0e-4166-9719-09a1f730fbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270711be-0e0e-4166-9719-09a1f730fbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2', 'volume_name': 'volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b60fe70-e5a1-479b-8c1e-1fd3f44de7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b60fe70-e5a1-479b-8c1e-1fd3f44de7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14832ccc-70ed-4b60-807f-6c6cc02fc046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:58:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Volume 7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2', 'volume_size': 1} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726003284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c690a71a1d6c44bc9905cac32859e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:58:59Z,use_quota=True,user_id='e9902189aef249c69a004d504cac56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Creating volume 7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:58:59 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:58:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:58:59 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 1073741824 Jun 27 19:58:59 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:01 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 1073741824" returned: 0 in 1.994s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:01 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 Jun 27 19:59:01 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:02 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" returned: 0 in 1.270s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] <== create_volume: return (3357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.366s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14832ccc-70ed-4b60-807f-6c6cc02fc046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204d3a93-13e6-4225-b9f3-2a42eb8a58e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:02 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Volume volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 (7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2): created successfully Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204d3a93-13e6-4225-b9f3-2a42eb8a58e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Flow 'volume_create_manager' (70798729-117c-4863-8268-9b13d13afda6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3bb9278b-a5f4-45d4-bab6-5f721517b099 tempest-VolumesDeleteCascade-539043637 None] Created volume successfully. Jun 27 19:59:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Creating offline snapshot e09abe68-9bc7-4609-9210-2a7e5c5d8a60 of volume 7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 19:59:04 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee7f8f-3070-4a46-b868-bb32053d196e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:04 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 Jun 27 19:59:04 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:06 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" returned: 0 in 2.058s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:06 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 1G Jun 27 19:59:06 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:07 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 1G" returned: 0 in 1.288s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:07 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:07 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:08 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.981s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:08 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 is being set with open permissions: ugo+rw Jun 27 19:59:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:08 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:08 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:09 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.689s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:09 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info Jun 27 19:59:09 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:10 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info" returned: 0 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:10 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info is being set with open permissions: ugo+rw Jun 27 19:59:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:10 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info Jun 27 19:59:10 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:11 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.info" returned: 0 in 0.754s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.690s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6389f35d-b968-4a50-9060-3082d4a66d55 tempest-VolumesDeleteCascade-539043637 None] Create snapshot completed successfully Jun 27 19:59:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Creating offline snapshot bb471fde-221c-4383-9e6f-addfb93cdbbd of volume 7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 19:59:12 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea03dba-e0a0-4b6f-a34d-665e5d9b9ee1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:12 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:12 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:12 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.820s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:12 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd 1G Jun 27 19:59:12 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Acquiring lock "cinder-47aaf734-3581-4a69-9b65-cbeb3e0094b7-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "cinder-47aaf734-3581-4a69-9b65-cbeb3e0094b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Acquiring lock "cinder-quobyte-47aaf734-3581-4a69-9b65-cbeb3e0094b7" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "cinder-quobyte-47aaf734-3581-4a69-9b65-cbeb3e0094b7" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b28060-1f8e-40e6-95e1-eff86a663123]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:13 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 Jun 27 19:59:13 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:13 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd 1G" returned: 0 in 0.891s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:13 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd Jun 27 19:59:13 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:14 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7" returned: 0 in 0.801s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:14 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7 Jun 27 19:59:14 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:14 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd" returned: 0 in 0.796s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:14 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd is being set with open permissions: ugo+rw Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:14 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd Jun 27 19:59:14 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:14 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-47aaf734-3581-4a69-9b65-cbeb3e0094b7" returned: 0 in 0.685s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "cinder-quobyte-47aaf734-3581-4a69-9b65-cbeb3e0094b7" released by "delete_volume" :: held 1.551s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Created reservations ['f3419e6f-628f-4b5d-88ad-cfb840440aa5', '63290470-50a3-4855-9518-caafaa4f5127', 'f66c3248-feeb-44d1-8574-7550efc189e0', 'ec5ee3b3-e5d6-4876-93da-395afad2d578'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:14 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:14 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:15 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd" returned: 0 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.388s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8fa113da-8339-494b-a04a-24c4d5068090 tempest-VolumesDeleteCascade-539043637 None] Create snapshot completed successfully Jun 27 19:59:15 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.682s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:15 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Deleted volume successfully. Jun 27 19:59:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9bc8130e-d1c9-4499-93b2-312e43b481fa tempest-AttachVolumeShelveTestJSON-684709757 None] Lock "cinder-47aaf734-3581-4a69-9b65-cbeb3e0094b7-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:16 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:16 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Performing cascade delete. {{(pid=93503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-bb471fde-221c-4383-9e6f-addfb93cdbbd-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-bb471fde-221c-4383-9e6f-addfb93cdbbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-bb471fde-221c-4383-9e6f-addfb93cdbbd" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-bb471fde-221c-4383-9e6f-addfb93cdbbd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Deleting offline snapshot bb471fde-221c-4383-9e6f-addfb93cdbbd of volume 7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] snapshot_file for this snap is: volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a6e18-6138-4107-8005-dd6b3c440af7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:16 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd Jun 27 19:59:16 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:16 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.764s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 19:59:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 19:59:17 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd" returned: 0 in 0.803s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:17 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb7a244-d904-462d-8378-ad927b54ecc5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:17 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:17 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:18 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.861s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:18 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd Jun 27 19:59:18 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:19 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd" returned: 0 in 0.901s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:19 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd Jun 27 19:59:19 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:19 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.bb471fde-221c-4383-9e6f-addfb93cdbbd" returned: 0 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-bb471fde-221c-4383-9e6f-addfb93cdbbd" released by "_delete_snapshot" :: held 3.425s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" released by "delete_snapshot" :: held 3.448s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:19 devstack cinder-volume[93503]: WARNING cinder.quota [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Created reservations ['f4b3c253-5691-4c36-8d32-ff6336a818a4', '645b80b3-f50d-43e5-9e86-99c3816f6709', '08bcbbf6-733f-445e-be0b-f0a3bb669fc7', 'a0d7647f-7700-4764-8ada-2e3184e75c6a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Delete snapshot completed successfully. Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-bb471fde-221c-4383-9e6f-addfb93cdbbd-delete_snapshot" released by "delete_snapshot" :: held 3.607s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-e09abe68-9bc7-4609-9210-2a7e5c5d8a60-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-e09abe68-9bc7-4609-9210-2a7e5c5d8a60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-e09abe68-9bc7-4609-9210-2a7e5c5d8a60" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-e09abe68-9bc7-4609-9210-2a7e5c5d8a60" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Deleting offline snapshot e09abe68-9bc7-4609-9210-2a7e5c5d8a60 of volume 7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] snapshot_file for this snap is: volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[987f0ace-7861-474f-ae59-64ca6458d88e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:20 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:20 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:20 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.864s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e94fc1-7ac6-49df-b981-4b9403bfcf91]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:21 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 Jun 27 19:59:21 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:21 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" returned: 0 in 0.860s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:21 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:21 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:22 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.782s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:22 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60 Jun 27 19:59:22 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Flow 'volume_create_manager' (67cc6f48-13c3-4049-9df9-0e14a5ec6312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edd61c7-17dd-4eef-b1d4-d311796455dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edd61c7-17dd-4eef-b1d4-d311796455dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-898155154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a98a7a-b031-444e-a841-fcbedbb1560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a5f041944b4397810230d1dd12c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:23Z,use_quota=True,user_id='0670af689e774fa8ad268715a1633783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40405ac-e06e-4457-9e01-2270f5fe5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40405ac-e06e-4457-9e01-2270f5fe5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89424313-0aa1-4eb6-b0fe-cd0a5e8e3ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89424313-0aa1-4eb6-b0fe-cd0a5e8e3ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a98a7a-b031-444e-a841-fcbedbb1560d', 'volume_name': 'volume-16a98a7a-b031-444e-a841-fcbedbb1560d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417185a1-08fa-4fe0-a231-4fbf861409e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417185a1-08fa-4fe0-a231-4fbf861409e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f767380-a466-4c78-820c-d952dab1158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:22 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Volume 16a98a7a-b031-444e-a841-fcbedbb1560d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a98a7a-b031-444e-a841-fcbedbb1560d', 'volume_size': 1} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-898155154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a98a7a-b031-444e-a841-fcbedbb1560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a5f041944b4397810230d1dd12c03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:23Z,use_quota=True,user_id='0670af689e774fa8ad268715a1633783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Creating volume 16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:59:22 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:59:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:22 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d 1073741824 Jun 27 19:59:22 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:23 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2.e09abe68-9bc7-4609-9210-2a7e5c5d8a60" returned: 0 in 0.841s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-e09abe68-9bc7-4609-9210-2a7e5c5d8a60" released by "_delete_snapshot" :: held 3.461s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" released by "delete_snapshot" :: held 3.494s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Created reservations ['7656d5b3-1c2e-4500-b53d-a7c6586b339e', '085cab61-fbb8-4889-9941-acba8a1cd755', '0eb84445-a8f5-4ba5-bbd7-922785f64cd5', '99e56db0-e18f-43f2-a3b9-23e436363cee'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Delete snapshot completed successfully. Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-e09abe68-9bc7-4609-9210-2a7e5c5d8a60-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Snapshots deleted, issuing volume delete {{(pid=93503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3471eb86-6087-438e-8ded-8a0813c09540]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:23 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 Jun 27 19:59:23 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:23 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d 1073741824" returned: 0 in 1.069s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:23 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d Jun 27 19:59:23 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Flow 'volume_create_manager' (18a3108b-0bd5-4823-831a-3c11c8525076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdf143a-1f41-40f4-b512-2430692b2a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdf143a-1f41-40f4-b512-2430692b2a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1954893623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98686e8e-2176-4171-95ff-9253ecd53c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee135d31504d33ad3909ed8319338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:24Z,use_quota=True,user_id='e430ceb5e2254b03bee67498ed744880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d47444b-9b27-4c7d-af79-25bd50e2e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d47444b-9b27-4c7d-af79-25bd50e2e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c0020c-b741-47ca-912b-6a0275fa00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c0020c-b741-47ca-912b-6a0275fa00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98686e8e-2176-4171-95ff-9253ecd53c34', 'volume_name': 'volume-98686e8e-2176-4171-95ff-9253ecd53c34', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09eaaa3-3078-4484-b7cc-270a369aa175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09eaaa3-3078-4484-b7cc-270a369aa175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f325dd29-6a0d-49af-94ca-c47b527d8de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:24 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Volume 98686e8e-2176-4171-95ff-9253ecd53c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98686e8e-2176-4171-95ff-9253ecd53c34', 'volume_size': 1} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:24 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" returned: 0 in 0.809s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:24 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2 Jun 27 19:59:24 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:24 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d" returned: 0 in 0.659s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1954893623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98686e8e-2176-4171-95ff-9253ecd53c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee135d31504d33ad3909ed8319338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:24Z,use_quota=True,user_id='e430ceb5e2254b03bee67498ed744880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Creating volume 98686e8e-2176-4171-95ff-9253ecd53c34 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:59:24 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f767380-a466-4c78-820c-d952dab1158e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a98a7a-b031-444e-a841-fcbedbb1560d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:24 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 1073741824 Jun 27 19:59:24 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59243fa-1ed1-4373-a792-9eb33645b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:24 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Volume volume-16a98a7a-b031-444e-a841-fcbedbb1560d (16a98a7a-b031-444e-a841-fcbedbb1560d): created successfully Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59243fa-1ed1-4373-a792-9eb33645b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Flow 'volume_create_manager' (67cc6f48-13c3-4049-9df9-0e14a5ec6312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-b997f930-caa4-4434-be59-0b5fe3f0fedd req-b78ba6eb-ccbc-4224-8ac5-bea993d525e5 tempest-VolumesSnapshotsTestJSON-281115573 None] Created volume successfully. Jun 27 19:59:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-0cd7aeaa-d9ab-410f-a6c4-291fa253ec5e req-bc39e2b2-fa15-4ed3-a734-55831335c80b tempest-ServerActionsTestOtherA-1089043092 None] Terminate volume connection completed successfully. Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-0cd7aeaa-d9ab-410f-a6c4-291fa253ec5e req-bc39e2b2-fa15-4ed3-a734-55831335c80b tempest-ServerActionsTestOtherA-1089043092 None] Deleting attachment 8467b39c-72fb-4c8b-8d78-38c056865d4e. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:25 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" returned: 0 in 0.839s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2" released by "delete_volume" :: held 1.727s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Created reservations ['e365c7f8-8ad2-4522-8a3b-70933671537e', 'ba03ba37-899d-4b7b-9426-8fe6e142d490', '83c0449a-8a88-47bf-baa0-467f11594589', 'e3532e03-2cc9-42fe-aed7-a0b311f84019'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:25 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:25 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:25 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 1073741824" returned: 0 in 0.996s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:25 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 Jun 27 19:59:25 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:26 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.681s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:26 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Deleted volume successfully. Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3a8af4d-6bc8-4e07-b1b6-4ae16cf322a7 tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-7e9cf65f-f1a8-4d22-bfb6-18171a9c37f2-delete_volume" released by "delete_volume" :: held 10.019s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:26 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34" returned: 0 in 0.702s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f325dd29-6a0d-49af-94ca-c47b527d8de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98686e8e-2176-4171-95ff-9253ecd53c34', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934f3cba-bdad-4500-89b2-baae60dec0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Creating offline snapshot 8e110c71-678c-4104-a0c4-b60c86d323ba of volume 16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 19:59:26 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Volume volume-98686e8e-2176-4171-95ff-9253ecd53c34 (98686e8e-2176-4171-95ff-9253ecd53c34): created successfully Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934f3cba-bdad-4500-89b2-baae60dec0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Flow 'volume_create_manager' (18a3108b-0bd5-4823-831a-3c11c8525076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47efe79-806e-4203-b11d-e7a0b64d98dc]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:26 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f0c50bcf-11e9-4a3d-9ebe-9c648f2cbe80 tempest-AttachVolumeNegativeTest-709673990 None] Created volume successfully. Jun 27 19:59:26 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d Jun 27 19:59:26 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Flow 'volume_create_manager' (9acd5585-722d-4cd7-a9c0-a7ff56fbe01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f790f4b9-a80b-484e-a7a4-5f531c575c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f790f4b9-a80b-484e-a7a4-5f531c575c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1403497768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8a69ac-dd8a-4aa8-acff-4036085b12cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c690a71a1d6c44bc9905cac32859e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:27Z,use_quota=True,user_id='e9902189aef249c69a004d504cac56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03095ac7-6778-439d-a9bb-5bc0060ef0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03095ac7-6778-439d-a9bb-5bc0060ef0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124ae515-1a73-4ee6-9c26-a1460c2432c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124ae515-1a73-4ee6-9c26-a1460c2432c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8a69ac-dd8a-4aa8-acff-4036085b12cd', 'volume_name': 'volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5831970d-c9bc-47b6-91f2-1e5c335a87cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5831970d-c9bc-47b6-91f2-1e5c335a87cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645b8eed-6188-4d65-b900-c076ea0f6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:26 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Volume fa8a69ac-dd8a-4aa8-acff-4036085b12cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd', 'volume_size': 1} Jun 27 19:59:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:27 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d" returned: 0 in 0.787s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:27 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba 1G Jun 27 19:59:27 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:28 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba 1G" returned: 0 in 0.807s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a98a7a-b031-444e-a841-fcbedbb1560d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:28 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a98a7a-b031-444e-a841-fcbedbb1560d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba Jun 27 19:59:28 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:28 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a98a7a-b031-444e-a841-fcbedbb1560d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba" returned: 0 in 0.856s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:28 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba is being set with open permissions: ugo+rw Jun 27 19:59:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:28 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba Jun 27 19:59:28 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:29 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba" returned: 0 in 0.691s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:29 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info Jun 27 19:59:29 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:30 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info" returned: 0 in 0.793s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:30 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info is being set with open permissions: ugo+rw Jun 27 19:59:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:30 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info Jun 27 19:59:30 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:31 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.info" returned: 0 in 0.723s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.770s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.200s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1403497768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8a69ac-dd8a-4aa8-acff-4036085b12cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c690a71a1d6c44bc9905cac32859e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:27Z,use_quota=True,user_id='e9902189aef249c69a004d504cac56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Creating volume fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:59:31 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:31 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd 1073741824 Jun 27 19:59:31 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-7864632c-2052-4aa3-9557-379cabf91e3b req-1c2751d3-7e64-45cb-bd97-e73d70cd9d90 tempest-VolumesSnapshotsTestJSON-281115573 None] Create snapshot completed successfully Jun 27 19:59:31 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd 1073741824" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:32 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:32 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "cinder-8e110c71-678c-4104-a0c4-b60c86d323ba-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-8e110c71-678c-4104-a0c4-b60c86d323ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "cinder-quobyte-16a98a7a-b031-444e-a841-fcbedbb1560d" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-quobyte-16a98a7a-b031-444e-a841-fcbedbb1560d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "cinder-quobyte-8e110c71-678c-4104-a0c4-b60c86d323ba" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-quobyte-8e110c71-678c-4104-a0c4-b60c86d323ba" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Deleting offline snapshot 8e110c71-678c-4104-a0c4-b60c86d323ba of volume 16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] snapshot_file for this snap is: volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7683c2a-964d-4dda-a5dc-81f54258d669]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:32 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba Jun 27 19:59:32 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:32 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 0.732s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.133s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645b8eed-6188-4d65-b900-c076ea0f6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c31bf39-375a-4d25-9ad0-3d001e7235ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e38e1-55e1-4e98-beef-ef8d64b258fa]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:32 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Volume volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd (fa8a69ac-dd8a-4aa8-acff-4036085b12cd): created successfully Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c31bf39-375a-4d25-9ad0-3d001e7235ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Flow 'volume_create_manager' (9acd5585-722d-4cd7-a9c0-a7ff56fbe01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c63b3445-aa01-450d-9dd1-7c6b02414ce0 tempest-VolumesDeleteCascade-539043637 None] Created volume successfully. Jun 27 19:59:32 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 Jun 27 19:59:32 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:33 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba" returned: 0 in 0.810s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a98a7a-b031-444e-a841-fcbedbb1560d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa65f756-cba8-44cc-9e27-12708272a7be]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:33 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d Jun 27 19:59:33 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:33 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34" returned: 0 in 0.835s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.232s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Creating offline snapshot 3216a364-a3c3-4600-9db0-a9ea3f84928e of volume fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a3ca1d-266f-4e10-8619-68977a449b10]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-98686e8e-2176-4171-95ff-9253ecd53c34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a118c86-87de-432c-86c1-b114d04d6cdc', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 19:59:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-13a8e606-c43b-48cf-bf0b-c9ab1f52d6a5 req-c07f5906-d0fb-4419-8134-bce29390557c tempest-AttachVolumeNegativeTest-709673990 None] attachment_update completed successfully. Jun 27 19:59:33 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:33 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:34 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d" returned: 0 in 0.893s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:34 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba Jun 27 19:59:34 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:34 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 0.850s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:34 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e 1G Jun 27 19:59:34 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:35 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba" returned: 0 in 0.826s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:35 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba Jun 27 19:59:35 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:35 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e 1G" returned: 0 in 1.060s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:35 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e Jun 27 19:59:35 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:35 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d.8e110c71-678c-4104-a0c4-b60c86d323ba" returned: 0 in 0.786s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=65,cinder:INSERT=17,cinder:UPDATE=54,cinder:DELETE=7 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=72,cinder:SELECT=79,cinder:DELETE=4,cinder:INSERT=10 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "cinder-27c31829-f629-4bb6-b225-88598049b434-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-quobyte-8e110c71-678c-4104-a0c4-b60c86d323ba" released by "_delete_snapshot" :: held 3.450s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-quobyte-16a98a7a-b031-444e-a841-fcbedbb1560d" released by "delete_snapshot" :: held 3.496s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Lock "cinder-27c31829-f629-4bb6-b225-88598049b434-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "cinder-quobyte-27c31829-f629-4bb6-b225-88598049b434" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Lock "cinder-quobyte-27c31829-f629-4bb6-b225-88598049b434" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG cinder.quota [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Created reservations ['6ec8ee51-7f59-4e10-869e-cd482560a7ea', '5240ca7e-6bbf-4b59-adc1-7fe45caa26f2', 'cb0a7b8d-c5f0-4e9a-b5fb-2041abea311a', '5073b770-30c3-45c5-b855-ccfb69f8ea7b'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[87376ea2-286d-462f-b3ad-bc06ff29ec0b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Delete snapshot completed successfully. Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-b327d461-74f7-4e5a-ace7-13e51d0ca48e req-51084b24-f71d-469a-b27f-c0ab799df410 tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-8e110c71-678c-4104-a0c4-b60c86d323ba-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:36 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 Jun 27 19:59:36 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:36 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:36 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e is being set with open permissions: ugo+rw Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:36 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e Jun 27 19:59:36 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "cinder-16a98a7a-b031-444e-a841-fcbedbb1560d-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:36 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434" returned: 0 in 0.793s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-16a98a7a-b031-444e-a841-fcbedbb1560d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:36 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434 Jun 27 19:59:36 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "cinder-quobyte-16a98a7a-b031-444e-a841-fcbedbb1560d" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-quobyte-16a98a7a-b031-444e-a841-fcbedbb1560d" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa7488-a145-4528-b145-c5a2e902ad2b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:37 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d Jun 27 19:59:37 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:37 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e" returned: 0 in 0.750s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:37 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info Jun 27 19:59:37 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:37 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-27c31829-f629-4bb6-b225-88598049b434" returned: 0 in 0.696s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Lock "cinder-quobyte-27c31829-f629-4bb6-b225-88598049b434" released by "delete_volume" :: held 1.544s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Created reservations ['fa5ef279-fa0d-4d32-8462-3d6c70ea25db', '44c0a2c7-3a29-4754-9673-ac50f729e9c3', 'ee55165f-62bc-4478-9a15-ab6baf00d776', 'a766da1b-1782-4557-a9bb-995b1c376bcd'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:37 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:37 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:37 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d" returned: 0 in 0.840s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:37 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d Jun 27 19:59:37 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:37 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info" returned: 0 in 0.703s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:37 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info is being set with open permissions: ugo+rw Jun 27 19:59:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:37 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info Jun 27 19:59:37 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:38 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.746s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Deleted volume successfully. Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-282de394-cc3c-4b6e-b81e-d86c04ec8067 tempest-ServerActionsTestOtherA-1089043092 None] Lock "cinder-27c31829-f629-4bb6-b225-88598049b434-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:38 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-16a98a7a-b031-444e-a841-fcbedbb1560d" returned: 0 in 0.812s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-quobyte-16a98a7a-b031-444e-a841-fcbedbb1560d" released by "delete_volume" :: held 1.725s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:38 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.info" returned: 0 in 0.751s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-495cc41b-0390-4537-b5b4-9fac11e18858 tempest-VolumesDeleteCascade-539043637 None] Create snapshot completed successfully Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG cinder.quota [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Created reservations ['8b76d0f4-9733-4b5d-b15a-75c9722a8893', 'd197b379-b672-427e-958b-c78145334410', 'b6869045-e37f-4515-ae66-591d9daffa7a', 'e17e165f-2a27-4ff2-9102-ef53a4de0f22'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:38 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:38 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:39 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.804s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:39 devstack cinder-volume[93503]: DEBUG cinder.manager [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Deleted volume successfully. Jun 27 19:59:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-2a905a9a-748e-436b-a0f5-e8de19f00825 req-0392770b-4287-4193-af23-8a4f74fce6eb tempest-VolumesSnapshotsTestJSON-281115573 None] Lock "cinder-16a98a7a-b031-444e-a841-fcbedbb1560d-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Flow 'volume_create_manager' (72dca47b-cfcc-40e7-a023-4361728cadb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4493a9ff-0121-4975-81d6-740c6b26ddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4493a9ff-0121-4975-81d6-740c6b26ddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1467629575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6321f0-c4a5-4575-bd03-bdebdceeac86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c690a71a1d6c44bc9905cac32859e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3216a364-a3c3-4600-9db0-a9ea3f84928e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:41Z,use_quota=True,user_id='e9902189aef249c69a004d504cac56c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542c3796-47ef-4f52-9798-bceaf052eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542c3796-47ef-4f52-9798-bceaf052eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ba3c97-529d-48ec-91bf-ec20ed28cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ba3c97-529d-48ec-91bf-ec20ed28cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d6321f0-c4a5-4575-bd03-bdebdceeac86', 'volume_name': 'volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86', 'volume_size': 1, 'snapshot_id': '3216a364-a3c3-4600-9db0-a9ea3f84928e'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eff3158-53ef-41b4-81a9-2e0ee41e5755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eff3158-53ef-41b4-81a9-2e0ee41e5755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dee7d7a-afb7-48c1-8e1f-43fe2e9a6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:40 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Volume 1d6321f0-c4a5-4575-bd03-bdebdceeac86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86', 'volume_size': 1, 'snapshot_id': '3216a364-a3c3-4600-9db0-a9ea3f84928e'} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-3216a364-a3c3-4600-9db0-a9ea3f84928e-1d6321f0-c4a5-4575-bd03-bdebdceeac86" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-3216a364-a3c3-4600-9db0-a9ea3f84928e-1d6321f0-c4a5-4575-bd03-bdebdceeac86" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Creating volume 1d6321f0-c4a5-4575-bd03-bdebdceeac86 from snapshot 3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:59:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-1d6321f0-c4a5-4575-bd03-bdebdceeac86" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-1d6321f0-c4a5-4575-bd03-bdebdceeac86" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] snapshot: 3216a364-a3c3-4600-9db0-a9ea3f84928e, volume: 1d6321f0-c4a5-4575-bd03-bdebdceeac86, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa71cb6-c10d-4461-be6b-b97f3297a839]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:41 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-09190d56-c9cf-4b63-a650-c81fdd24df0e req-e0b78948-dbe1-4c78-aa80-14af668374b1 tempest-AttachVolumeNegativeTest-709673990 None] Terminate volume connection completed successfully. Jun 27 19:59:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-09190d56-c9cf-4b63-a650-c81fdd24df0e req-e0b78948-dbe1-4c78-aa80-14af668374b1 tempest-AttachVolumeNegativeTest-709673990 None] Deleting attachment 5a118c86-87de-432c-86c1-b114d04d6cdc. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 19:59:41 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e Jun 27 19:59:41 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:42 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e" returned: 0 in 1.134s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 19:59:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 19:59:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57aa57-8e09-4a08-90d1-fbf40a07f877]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:42 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:42 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:43 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 1.004s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:43 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 19:59:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:43 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 Jun 27 19:59:43 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Flow 'volume_create_manager' (47de3b96-b008-4234-99d0-9613cc4afa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7589a387-3f24-42d3-9af8-a83d0191625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7589a387-3f24-42d3-9af8-a83d0191625a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-944714707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7bcd83-d192-440f-ba2d-cd14467d6ace,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c086196d2556468aa2d83873b90774b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:45Z,use_quota=True,user_id='c6165dabb3b54bb5ae0c87908215b47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcdb5d4-59fc-4a78-8564-4f959b8dfc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcdb5d4-59fc-4a78-8564-4f959b8dfc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392b6e53-e1f0-4e94-8dba-0fc9d740177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392b6e53-e1f0-4e94-8dba-0fc9d740177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7bcd83-d192-440f-ba2d-cd14467d6ace', 'volume_name': 'volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dd18f3-65de-4e31-959c-0657f54bee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dd18f3-65de-4e31-959c-0657f54bee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8a5bb3-eaf8-43a7-8ac5-35d73b6df764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Volume 7a7bcd83-d192-440f-ba2d-cd14467d6ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace', 'volume_size': 1} Jun 27 19:59:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:50 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86" returned: 0 in 6.721s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:50 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9665e18d-8d74-4902-a028-9086ab4529c2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:50 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:50 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:51 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 0.973s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 19:59:51 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Converted 1024.00 MB image at 152.35 MB/s Jun 27 19:59:51 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 is being set with open permissions: ugo+rw Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:51 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 Jun 27 19:59:51 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:51 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86" returned: 0 in 0.659s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-1d6321f0-c4a5-4575-bd03-bdebdceeac86" released by "_copy_volume_from_snapshot" :: held 10.665s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-3216a364-a3c3-4600-9db0-a9ea3f84928e-1d6321f0-c4a5-4575-bd03-bdebdceeac86" released by "_create_volume_from_snapshot" :: held 10.732s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.758s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.872s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-944714707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7bcd83-d192-440f-ba2d-cd14467d6ace,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c086196d2556468aa2d83873b90774b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T17:59:45Z,use_quota=True,user_id='c6165dabb3b54bb5ae0c87908215b47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Creating volume 7a7bcd83-d192-440f-ba2d-cd14467d6ace {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 19:59:51 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:51 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace 1073741824 Jun 27 19:59:51 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dee7d7a-afb7-48c1-8e1f-43fe2e9a6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86', 'volume_size': 1, 'snapshot_id': '3216a364-a3c3-4600-9db0-a9ea3f84928e'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bce483a-e225-428a-8492-135d5b568711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Volume volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 (1d6321f0-c4a5-4575-bd03-bdebdceeac86): created successfully Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bce483a-e225-428a-8492-135d5b568711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Flow 'volume_create_manager' (72dca47b-cfcc-40e7-a023-4361728cadb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-50cf1cc4-bd65-4b98-a9fe-8c69b9bc259b tempest-VolumesDeleteCascade-539043637 None] Created volume successfully. Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-fa8a69ac-dd8a-4aa8-acff-4036085b12cd-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-fa8a69ac-dd8a-4aa8-acff-4036085b12cd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Performing cascade delete. {{(pid=93503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-3216a364-a3c3-4600-9db0-a9ea3f84928e-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-3216a364-a3c3-4600-9db0-a9ea3f84928e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-3216a364-a3c3-4600-9db0-a9ea3f84928e" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-3216a364-a3c3-4600-9db0-a9ea3f84928e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Deleting offline snapshot 3216a364-a3c3-4600-9db0-a9ea3f84928e of volume fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] snapshot_file for this snap is: volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b8fa75-58c0-4798-99fa-b4baf2034138]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:52 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e Jun 27 19:59:52 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace 1073741824" returned: 0 in 1.049s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:52 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:52 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace Jun 27 19:59:52 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:53 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e" returned: 0 in 0.954s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbf19c5-c5db-4840-93ba-9c6fe9c39cc3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:53 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:53 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:53 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace" returned: 0 in 0.943s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8a5bb3-eaf8-43a7-8ac5-35d73b6df764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a23e20-408d-4c1d-a816-6d92c19564c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 19:59:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Volume volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace (7a7bcd83-d192-440f-ba2d-cd14467d6ace): created successfully Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a23e20-408d-4c1d-a816-6d92c19564c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 19:59:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Flow 'volume_create_manager' (47de3b96-b008-4234-99d0-9613cc4afa40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 19:59:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-7ace8143-a602-41f8-9e4a-43fe346a04c1 req-53eb9f1f-35c7-4f30-9cf8-42e7d38c1815 tempest-VolumesGetTestJSON-572726678 None] Created volume successfully. Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "cinder-98686e8e-2176-4171-95ff-9253ecd53c34-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-98686e8e-2176-4171-95ff-9253ecd53c34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "cinder-quobyte-98686e8e-2176-4171-95ff-9253ecd53c34" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-quobyte-98686e8e-2176-4171-95ff-9253ecd53c34" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a99739c-c16d-4d83-a4af-5d6485194d04]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:54 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 1.061s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:54 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e Jun 27 19:59:54 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:54 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 Jun 27 19:59:54 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Acquiring lock "cinder-7a7bcd83-d192-440f-ba2d-cd14467d6ace-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Lock "cinder-7a7bcd83-d192-440f-ba2d-cd14467d6ace-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Acquiring lock "cinder-quobyte-7a7bcd83-d192-440f-ba2d-cd14467d6ace" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Lock "cinder-quobyte-7a7bcd83-d192-440f-ba2d-cd14467d6ace" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c03d49b-2334-4ef3-b730-11becfb448c2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:55 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34" returned: 0 in 0.976s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:55 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace Jun 27 19:59:55 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:55 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:55 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34 Jun 27 19:59:55 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e" returned: 0 in 0.944s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:55 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e Jun 27 19:59:55 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:56 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-98686e8e-2176-4171-95ff-9253ecd53c34" returned: 0 in 0.756s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-quobyte-98686e8e-2176-4171-95ff-9253ecd53c34" released by "delete_volume" :: held 1.808s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:56 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace" returned: 0 in 0.924s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Created reservations ['9c4df485-f0a3-4fdd-8ec7-9aa0e4f41dbf', '03954227-a699-4e2f-919e-64a9263f571d', 'a16cbf1c-67bc-44e0-afab-8223cd269916', 'fe4a62c3-b908-42c8-9f67-207d0272eca6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:56 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace Jun 27 19:59:56 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:56 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd.3216a364-a3c3-4600-9db0-a9ea3f84928e" returned: 0 in 0.816s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-3216a364-a3c3-4600-9db0-a9ea3f84928e" released by "_delete_snapshot" :: held 3.984s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" released by "delete_snapshot" :: held 4.025s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Created reservations ['a40228ed-11de-4fee-a7e0-d38e52807185', '2186ef44-36a2-4f49-8314-c6375feccbdc', 'efa455e7-1622-461a-bae7-c4d9ba1ad57f', '1df246aa-c49a-4048-8b79-c64993ca8f61'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:56 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:56 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Delete snapshot completed successfully. Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-3216a364-a3c3-4600-9db0-a9ea3f84928e-delete_snapshot" released by "delete_snapshot" :: held 4.258s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Snapshots deleted, issuing volume delete {{(pid=93503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e48c4f0-2e29-4e18-a88d-8b16d633208b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "cinder-942be50d-d96d-4e57-8e5a-c641d60777e4-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:56 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:56 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-942be50d-d96d-4e57-8e5a-c641d60777e4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "cinder-quobyte-942be50d-d96d-4e57-8e5a-c641d60777e4" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-quobyte-942be50d-d96d-4e57-8e5a-c641d60777e4" acquired by "delete_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b69db0-ab38-48f8-b196-45384742b843]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:56 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 Jun 27 19:59:56 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:57 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7a7bcd83-d192-440f-ba2d-cd14467d6ace" returned: 0 in 1.092s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Lock "cinder-quobyte-7a7bcd83-d192-440f-ba2d-cd14467d6ace" released by "delete_volume" :: held 2.071s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG cinder.quota [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Created reservations ['0f2ad163-10fa-4b7d-bf4d-ba83035f1d9a', '0e0d614f-6937-46d3-8c4f-4f76ba30ba01', 'a517234e-b6f1-42f8-8aff-5df9470287ea', '153f8af3-9a41-411d-9a05-c6fe6810a27e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:57 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.095s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:57 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Deleted volume successfully. Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-04d1107a-4eeb-4073-bd3e-c476943a81cb tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-98686e8e-2176-4171-95ff-9253ecd53c34-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:57 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 1.022s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:57 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:57 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:57 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd Jun 27 19:59:57 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:57 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4" returned: 0 in 1.074s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:57 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4 Jun 27 19:59:57 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:58 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" returned: 0 in 0.926s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-fa8a69ac-dd8a-4aa8-acff-4036085b12cd" released by "delete_volume" :: held 2.053s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:58 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.051s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.manager [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Deleted volume successfully. Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Created reservations ['61061017-0bbe-466f-9326-0a95ab9e312a', '234acf63-e554-4e0c-99cb-ee3dbb11e164', '03a215a2-de10-41b4-9aa5-99eeccbb50cb', 'ac32a6e0-96fc-403e-9819-809b05105216'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-d945de25-77d3-4393-bafb-ebe6bdf49618 req-4191739d-7218-409b-92a0-cc37360cdb49 tempest-VolumesGetTestJSON-572726678 None] Lock "cinder-7a7bcd83-d192-440f-ba2d-cd14467d6ace-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:58 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:58 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:58 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-942be50d-d96d-4e57-8e5a-c641d60777e4" returned: 0 in 1.054s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-quobyte-942be50d-d96d-4e57-8e5a-c641d60777e4" released by "delete_volume" :: held 2.203s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Created reservations ['d07446dc-b2ce-4a77-ac85-96522bf1c6d7', '087122cd-b907-435a-bafb-3f5ec8f4a340', '06e7335a-2ded-46f4-9e43-04cfb6d5bf50', '975e72db-5394-454b-b6bf-6ca42b0acb9d'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-1d6321f0-c4a5-4575-bd03-bdebdceeac86-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-1d6321f0-c4a5-4575-bd03-bdebdceeac86-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "cinder-quobyte-1d6321f0-c4a5-4575-bd03-bdebdceeac86" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-1d6321f0-c4a5-4575-bd03-bdebdceeac86" acquired by "delete_volume" :: waited 0.081s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 19:59:59 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 19:59:59 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2bdce5-0de8-4803-97f8-29fa04d02292]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 19:59:59 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 Jun 27 19:59:59 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 19:59:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b26a00b8-8b79-480e-8f98-1b36501478b5 tempest-GroupSnapshotsTest-296585406 None] Group tempest-GroupSnapshotsTest-Group-18892358: creating Jun 27 19:59:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b26a00b8-8b79-480e-8f98-1b36501478b5 tempest-GroupSnapshotsTest-296585406 None] Group tempest-GroupSnapshotsTest-Group-18892358: created successfully Jun 27 19:59:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b26a00b8-8b79-480e-8f98-1b36501478b5 tempest-GroupSnapshotsTest-296585406 None] Create group completed successfully. Jun 27 19:59:59 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.118s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 19:59:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Deleted volume successfully. Jun 27 19:59:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f62f314e-ebdf-426e-bb5b-a052d125a12d tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-fa8a69ac-dd8a-4aa8-acff-4036085b12cd-delete_volume" released by "delete_volume" :: held 7.790s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "cinder-8e0c3006-6615-4103-a9dc-42b38bf4449e-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:00 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.039s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-8e0c3006-6615-4103-a9dc-42b38bf4449e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Deleted volume successfully. Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4968ff21-6896-4c79-ad60-5f5259672251 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-942be50d-d96d-4e57-8e5a-c641d60777e4-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "cinder-quobyte-8e0c3006-6615-4103-a9dc-42b38bf4449e" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-quobyte-8e0c3006-6615-4103-a9dc-42b38bf4449e" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:00 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86" returned: 0 in 1.050s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8814b79-e992-4764-b258-aedd37cb8e9a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:00 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86 Jun 27 20:00:00 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:00 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e Jun 27 20:00:00 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:01 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d6321f0-c4a5-4575-bd03-bdebdceeac86" returned: 0 in 0.694s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-quobyte-1d6321f0-c4a5-4575-bd03-bdebdceeac86" released by "delete_volume" :: held 1.833s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Created reservations ['58fd5f04-c236-4b1e-8f96-8fbe45e8d27c', '581b28c9-8a6c-4754-94f7-c64df5e5cecd', 'e8c86164-4c6a-474c-b20a-314ad2234ead', 'f3e41eff-17e5-47e6-9850-9b8e241930a7'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:01 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:01 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:01 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e" returned: 0 in 1.008s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:01 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e Jun 27 20:00:01 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (ed9513b1-1786-469d-936b-99d06f1a1c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354291b3-3e32-441f-80cc-620e97f6f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354291b3-3e32-441f-80cc-620e97f6f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644135674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e29aa529-0126-4a54-ad72-4a325d595ed1,host='devstack@QuobyteHD#QuobyteHD',id=5d44c43a-9656-443d-8eaa-451fed3ed86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:02Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9762880d-0a43-46ef-8543-cca89ad2129c),volume_type_id=9762880d-0a43-46ef-8543-cca89ad2129c)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e0d313-df0e-441f-aa96-e49c26a9c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e0d313-df0e-441f-aa96-e49c26a9c07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd475e96-1753-4873-bfc7-8f59f4f824c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd475e96-1753-4873-bfc7-8f59f4f824c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d44c43a-9656-443d-8eaa-451fed3ed86a', 'volume_name': 'volume-5d44c43a-9656-443d-8eaa-451fed3ed86a', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a982914-529a-4e69-b72e-e4b3c5002918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a982914-529a-4e69-b72e-e4b3c5002918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f24d88-4e1c-4af5-a13f-4136df45bef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Volume 5d44c43a-9656-443d-8eaa-451fed3ed86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d44c43a-9656-443d-8eaa-451fed3ed86a', 'volume_size': 1} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e29aa529-0126-4a54-ad72-4a325d595ed1,created_at=2026-06-27T18:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644135674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e29aa529-0126-4a54-ad72-4a325d595ed1,host='devstack@QuobyteHD#QuobyteHD',id=5d44c43a-9656-443d-8eaa-451fed3ed86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:02Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9762880d-0a43-46ef-8543-cca89ad2129c),volume_type_id=9762880d-0a43-46ef-8543-cca89ad2129c)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Creating volume 5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:01 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:01 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a 1073741824 Jun 27 20:00:01 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:02 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.965s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Deleted volume successfully. Jun 27 20:00:02 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c3006-6615-4103-a9dc-42b38bf4449e" returned: 0 in 0.882s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-quobyte-8e0c3006-6615-4103-a9dc-42b38bf4449e" released by "delete_volume" :: held 1.954s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-91396a56-bec1-4c5f-a7b0-026e7f15f40c tempest-VolumesDeleteCascade-539043637 None] Lock "cinder-1d6321f0-c4a5-4575-bd03-bdebdceeac86-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Created reservations ['a1ed0a07-ffea-45d8-a497-edbe15d1c775', '9146cfbd-5408-4957-a39b-5824eb81c09e', '29fb6de7-5b22-40ae-98b5-7d593dc8438e', '46643066-9874-49b5-a885-2454bd1dd263'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:02 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:02 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:03 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a 1073741824" returned: 0 in 1.379s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:03 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:03 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:03 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.155s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:03 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Deleted volume successfully. Jun 27 20:00:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a4d832e3-76bf-4556-81c3-7b21570210e6 tempest-AttachVolumeNegativeTest-709673990 None] Lock "cinder-8e0c3006-6615-4103-a9dc-42b38bf4449e-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:04 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 0.841s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f24d88-4e1c-4af5-a13f-4136df45bef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d44c43a-9656-443d-8eaa-451fed3ed86a', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb29b39-8c48-43ac-a9c5-0661f0bceb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:04 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Volume volume-5d44c43a-9656-443d-8eaa-451fed3ed86a (5d44c43a-9656-443d-8eaa-451fed3ed86a): created successfully Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb29b39-8c48-43ac-a9c5-0661f0bceb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (ed9513b1-1786-469d-936b-99d06f1a1c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-39fa3b97-0377-45c1-8691-2dede4ecc074 tempest-GroupSnapshotsTest-296585406 None] Created volume successfully. Jun 27 20:00:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] GroupSnapshot 97f81186-5791-477c-90f7-32f415e27785: creating. Jun 27 20:00:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Group snapshot 97f81186-5791-477c-90f7-32f415e27785: creating. {{(pid=93503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 20:00:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Creating offline snapshot b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 of volume 5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:00:05 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf8e9d5-3588-404a-b589-3c2065decb43]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:06 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:06 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:06 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 0.918s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:06 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 1G Jun 27 20:00:07 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Flow 'volume_create_manager' (d8cc6d15-f205-49d3-bb45-bb878099c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6167793-c425-4949-9e98-3b638e7449fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6167793-c425-4949-9e98-3b638e7449fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1222162420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b234527b-ff34-43a9-83be-7c14780cb654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3acac4d902413c9025872583006912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:08Z,use_quota=True,user_id='991817ca88e1499d9739888af39f75e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b285c504-d5a6-4558-93c3-7782cdfce3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b285c504-d5a6-4558-93c3-7782cdfce3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6097eae5-339c-42d8-8641-47c1705e4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6097eae5-339c-42d8-8641-47c1705e4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b234527b-ff34-43a9-83be-7c14780cb654', 'volume_name': 'volume-b234527b-ff34-43a9-83be-7c14780cb654', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bf140b-c888-4abe-a974-40d56d49f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bf140b-c888-4abe-a974-40d56d49f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f1b961-4bad-42ff-a07a-b17ef6366edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Volume b234527b-ff34-43a9-83be-7c14780cb654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b234527b-ff34-43a9-83be-7c14780cb654', 'volume_size': 1} Jun 27 20:00:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:08 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 1G" returned: 0 in 1.157s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d44c43a-9656-443d-8eaa-451fed3ed86a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:08 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d44c43a-9656-443d-8eaa-451fed3ed86a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 Jun 27 20:00:08 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2486e20b-5739-41f7-8468-c6c2c2560404 tempest-GroupsTest-2144281134 None] Group tempest-Group1-1588675481: creating Jun 27 20:00:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2486e20b-5739-41f7-8468-c6c2c2560404 tempest-GroupsTest-2144281134 None] Group tempest-Group1-1588675481: created successfully Jun 27 20:00:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2486e20b-5739-41f7-8468-c6c2c2560404 tempest-GroupsTest-2144281134 None] Create group completed successfully. Jun 27 20:00:08 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d44c43a-9656-443d-8eaa-451fed3ed86a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" returned: 0 in 0.757s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:08 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:00:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:08 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 Jun 27 20:00:08 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a39ab48f-30d0-4950-98cf-d73c152d1c98 tempest-GroupsTest-2144281134 None] Group tempest-Group2-1306397892: creating Jun 27 20:00:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a39ab48f-30d0-4950-98cf-d73c152d1c98 tempest-GroupsTest-2144281134 None] Group tempest-Group2-1306397892: created successfully Jun 27 20:00:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a39ab48f-30d0-4950-98cf-d73c152d1c98 tempest-GroupsTest-2144281134 None] Create group completed successfully. Jun 27 20:00:09 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" returned: 0 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:09 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info Jun 27 20:00:09 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:10 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info" returned: 0 in 0.664s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:10 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:00:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:10 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info Jun 27 20:00:10 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:10 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.info" returned: 0 in 0.722s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.067s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.123s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1222162420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b234527b-ff34-43a9-83be-7c14780cb654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3acac4d902413c9025872583006912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:08Z,use_quota=True,user_id='991817ca88e1499d9739888af39f75e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Creating volume b234527b-ff34-43a9-83be-7c14780cb654 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:11 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:11 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 1073741824 Jun 27 20:00:11 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Flow 'volume_create_manager' (c3575217-4ad5-4d9d-80ee-440316256259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e999e5-b50b-473b-bced-aa0af2c2d391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-50e121f3-44c5-4596-992a-835b3bab1fa4 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 97f81186-5791-477c-90f7-32f415e27785: created successfully Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e999e5-b50b-473b-bced-aa0af2c2d391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498595692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=558c3dbe-2c93-45f2-ad7b-8151d6026500,host='devstack@QuobyteHD#QuobyteHD',id=1d46c04a-c193-4620-b9fe-8885ceb7f573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540021debc784d9f99f49940377cc6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:11Z,use_quota=True,user_id='c909b7675f9e4a7ead51422da4da2bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(199b29a4-8218-48b7-b6eb-fa47912eed58),volume_type_id=199b29a4-8218-48b7-b6eb-fa47912eed58)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d68727-7080-4140-bbc8-b0fb3efbd563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d68727-7080-4140-bbc8-b0fb3efbd563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eb3cc2-1fba-4c6d-95a6-0ece4c3b5a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eb3cc2-1fba-4c6d-95a6-0ece4c3b5a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d46c04a-c193-4620-b9fe-8885ceb7f573', 'volume_name': 'volume-1d46c04a-c193-4620-b9fe-8885ceb7f573', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01430a49-4877-4420-aa55-38e07db44052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01430a49-4877-4420-aa55-38e07db44052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d789950-9013-4263-96c5-c07eb56954fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Volume 1d46c04a-c193-4620-b9fe-8885ceb7f573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d46c04a-c193-4620-b9fe-8885ceb7f573', 'volume_size': 1} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Flow 'volume_create_manager' (6ba6fcfa-9891-4057-8fba-48ea9c1ce8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ebc705-9a54-4956-bb6e-242d23ed2477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ebc705-9a54-4956-bb6e-242d23ed2477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1600854879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab13eb5-393c-411b-bdf2-a2673a000186,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='379645a18cf64fea8bf75d38e0d134c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:11Z,use_quota=True,user_id='144d8b15238348e998504936f3469105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a132f6-e9ab-4c20-a6f5-1fcf1076c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a132f6-e9ab-4c20-a6f5-1fcf1076c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50876fa-a9bb-4472-8350-f8715f6cf163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50876fa-a9bb-4472-8350-f8715f6cf163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab13eb5-393c-411b-bdf2-a2673a000186', 'volume_name': 'volume-9ab13eb5-393c-411b-bdf2-a2673a000186', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cd4548-4a21-432e-800d-1470aec6e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cd4548-4a21-432e-800d-1470aec6e6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8240a4-65a3-4c8b-8110-bdf06809f8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Volume 9ab13eb5-393c-411b-bdf2-a2673a000186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab13eb5-393c-411b-bdf2-a2673a000186', 'volume_size': 1} Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:11 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 1073741824" returned: 0 in 0.928s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:12 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 Jun 27 20:00:12 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:12 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654" returned: 0 in 0.661s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=558c3dbe-2c93-45f2-ad7b-8151d6026500,created_at=2026-06-27T18:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498595692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=558c3dbe-2c93-45f2-ad7b-8151d6026500,host='devstack@QuobyteHD#QuobyteHD',id=1d46c04a-c193-4620-b9fe-8885ceb7f573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540021debc784d9f99f49940377cc6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:11Z,use_quota=True,user_id='c909b7675f9e4a7ead51422da4da2bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(199b29a4-8218-48b7-b6eb-fa47912eed58),volume_type_id=199b29a4-8218-48b7-b6eb-fa47912eed58)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Creating volume 1d46c04a-c193-4620-b9fe-8885ceb7f573 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:12 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:12 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 1073741824 Jun 27 20:00:12 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f1b961-4bad-42ff-a07a-b17ef6366edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b234527b-ff34-43a9-83be-7c14780cb654', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d158ebd0-e63b-459a-9bfa-12c6db2b73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:12 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Volume volume-b234527b-ff34-43a9-83be-7c14780cb654 (b234527b-ff34-43a9-83be-7c14780cb654): created successfully Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d158ebd0-e63b-459a-9bfa-12c6db2b73d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Flow 'volume_create_manager' (d8cc6d15-f205-49d3-bb45-bb878099c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0b3eddcd-ae46-4d26-82bb-4221548e793c tempest-VolumesTransfersTest-376809210 None] Created volume successfully. Jun 27 20:00:13 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 1073741824" returned: 0 in 0.850s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:13 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 Jun 27 20:00:13 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0e7b708b-3fa6-4cf9-8cb1-bb0c8fca6b33 tempest-VolumesTransfersTest-2029366635 None] Transfer volume completed successfully. Jun 27 20:00:14 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573" returned: 0 in 0.642s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.656s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1600854879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab13eb5-393c-411b-bdf2-a2673a000186,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='379645a18cf64fea8bf75d38e0d134c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:11Z,use_quota=True,user_id='144d8b15238348e998504936f3469105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Creating volume 9ab13eb5-393c-411b-bdf2-a2673a000186 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:14 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d789950-9013-4263-96c5-c07eb56954fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d46c04a-c193-4620-b9fe-8885ceb7f573', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:14 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 1073741824 Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbe9116-b3f0-44ba-be3f-0f2779c144bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:14 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:14 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Volume volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 (1d46c04a-c193-4620-b9fe-8885ceb7f573): created successfully Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbe9116-b3f0-44ba-be3f-0f2779c144bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Flow 'volume_create_manager' (c3575217-4ad5-4d9d-80ee-440316256259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:14 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f75bcdbd-b7db-43d3-a0d7-9f4ab81c1f6f tempest-GroupsTest-2144281134 None] Created volume successfully. Jun 27 20:00:15 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 1073741824" returned: 0 in 0.842s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:15 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 Jun 27 20:00:15 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Acquiring lock "cinder-b234527b-ff34-43a9-83be-7c14780cb654-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-b234527b-ff34-43a9-83be-7c14780cb654-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Acquiring lock "cinder-quobyte-b234527b-ff34-43a9-83be-7c14780cb654" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-quobyte-b234527b-ff34-43a9-83be-7c14780cb654" acquired by "delete_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[566fc5ed-61ac-4390-a31f-55d9bbc8f16e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:15 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 Jun 27 20:00:15 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Acquiring lock "cinder-quobyte-1d46c04a-c193-4620-b9fe-8885ceb7f573" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Lock "cinder-quobyte-1d46c04a-c193-4620-b9fe-8885ceb7f573" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8b669-f267-4764-b898-20a149b46957]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:15 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186" returned: 0 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:15 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 Jun 27 20:00:15 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.308s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7-74a2e402-543c-4c18-8f1b-8fade9cdf06f" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8240a4-65a3-4c8b-8110-bdf06809f8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab13eb5-393c-411b-bdf2-a2673a000186', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43efb2a8-e884-4d97-a477-9ecbe7a69bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7-74a2e402-543c-4c18-8f1b-8fade9cdf06f" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Creating volume 74a2e402-543c-4c18-8f1b-8fade9cdf06f from snapshot b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-74a2e402-543c-4c18-8f1b-8fade9cdf06f" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:15 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Volume volume-9ab13eb5-393c-411b-bdf2-a2673a000186 (9ab13eb5-393c-411b-bdf2-a2673a000186): created successfully Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43efb2a8-e884-4d97-a477-9ecbe7a69bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Flow 'volume_create_manager' (6ba6fcfa-9891-4057-8fba-48ea9c1ce8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-74a2e402-543c-4c18-8f1b-8fade9cdf06f" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] snapshot: b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7, volume: 74a2e402-543c-4c18-8f1b-8fade9cdf06f, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:00:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8f116db8-0d16-49d6-8f7a-97ec4db390c4 tempest-VolumesTestJSON-2106246446 None] Created volume successfully. Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc916d9-3080-4223-b32e-41daa38c7b7f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:16 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 Jun 27 20:00:16 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:16 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654" returned: 0 in 0.848s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:16 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654 Jun 27 20:00:16 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:16 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:16 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:16 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573" returned: 0 in 1.111s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:16 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" returned: 0 in 0.854s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d44c43a-9656-443d-8eaa-451fed3ed86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:00:16 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573 Jun 27 20:00:16 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7ed06-9d51-41a6-86c2-68f5224bd24b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:16 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b234527b-ff34-43a9-83be-7c14780cb654" returned: 0 in 0.775s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-quobyte-b234527b-ff34-43a9-83be-7c14780cb654" released by "delete_volume" :: held 1.683s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:16 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.781s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:00:17 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:17 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Created reservations ['2fc4cb92-cae0-4f5a-b3e8-796d8abd6983', 'aac86a04-f700-4b31-8039-5cd30047727a', '74051c4d-9e35-4a6b-836a-7d643c4acd35', '331bb782-bbfa-4e5e-ad70-e914053c5dbf'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:17 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:17 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Flow 'volume_create_manager' (baee1c37-12bc-4ab2-b841-883ffbf937a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1527c-ee52-4ed5-9292-3b192e2098ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1527c-ee52-4ed5-9292-3b192e2098ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2123607783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259666b1-2da5-43fa-9960-80453a1d596b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='379645a18cf64fea8bf75d38e0d134c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:18Z,use_quota=True,user_id='144d8b15238348e998504936f3469105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4983fd54-2ec0-4516-af39-c239a65de2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4983fd54-2ec0-4516-af39-c239a65de2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e62e353-7d28-485b-858f-b009eb8b576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e62e353-7d28-485b-858f-b009eb8b576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259666b1-2da5-43fa-9960-80453a1d596b', 'volume_name': 'volume-259666b1-2da5-43fa-9960-80453a1d596b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebcd8cf-39ab-44fb-94b8-f0823b403ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebcd8cf-39ab-44fb-94b8-f0823b403ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6101e2f-a198-4b97-ab65-1526ca2bb90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:17 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Volume 259666b1-2da5-43fa-9960-80453a1d596b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259666b1-2da5-43fa-9960-80453a1d596b', 'volume_size': 1} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:17 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d46c04a-c193-4620-b9fe-8885ceb7f573" returned: 0 in 0.985s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Lock "cinder-quobyte-1d46c04a-c193-4620-b9fe-8885ceb7f573" released by "delete_volume" :: held 2.151s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:17 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 1.031s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:17 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f Jun 27 20:00:17 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:17 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Created reservations ['cfa4d44b-c9c5-4b15-a0e0-b60354934848'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:17 devstack cinder-volume[93503]: WARNING cinder.quota [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1893932198 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1893932198, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:17 devstack cinder-volume[93503]: WARNING cinder.quota [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1893932198 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1893932198, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Created reservations ['164127df-1b54-4206-90ff-1c57497be905', 'a3fa9b4f-1cf9-4a90-97b2-12449f0131f2', '511cc9fa-1d58-497c-a4eb-8c19c34cb985', 'bf561888-9e8d-493b-b4d8-77bef9bbbe6f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:18 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.893s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:18 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Deleted volume successfully. Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7ccf5525-c533-47d9-8b6f-2f27f76839db tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-b234527b-ff34-43a9-83be-7c14780cb654-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:18 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:18 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Flow 'volume_create_manager' (bbc1122f-500c-46b0-8438-ae0a54b43a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d73129-b383-4459-8215-18f571fe47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d73129-b383-4459-8215-18f571fe47d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-55913134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfe381d-7809-4dcc-8cee-02e9b22d4e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3acac4d902413c9025872583006912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:18Z,use_quota=True,user_id='991817ca88e1499d9739888af39f75e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d4adf8-cbd5-41ca-98c6-903e9ebd1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d4adf8-cbd5-41ca-98c6-903e9ebd1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0debfe8-af62-4617-a7c9-71aaf047eff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0debfe8-af62-4617-a7c9-71aaf047eff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfe381d-7809-4dcc-8cee-02e9b22d4e64', 'volume_name': 'volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222c2a94-d9dd-482a-bb80-e42e24b68c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222c2a94-d9dd-482a-bb80-e42e24b68c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3302b7-496f-4b6b-a2f2-0ac022b0f00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:18 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Volume 5cfe381d-7809-4dcc-8cee-02e9b22d4e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64', 'volume_size': 1} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Created reservations ['4be8eeb6-1c93-4714-9a62-aef028efbc1a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:18 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:18 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:19 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.854s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:19 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-398ee554-c064-4a11-8643-b61a763e450b tempest-GroupsTest-2144281134 None] Delete group completed successfully. Jun 27 20:00:19 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.151s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:19 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-771d7dfc-dbbb-4402-80fe-6c5b45b1f110 tempest-GroupsTest-2144281134 None] Delete group completed successfully. Jun 27 20:00:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1aed9875-4e56-49d7-98d3-3d65c546a660 tempest-GroupsTest-2144281134 None] Group tempest-GroupsTest-Group-595376200: creating Jun 27 20:00:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1aed9875-4e56-49d7-98d3-3d65c546a660 tempest-GroupsTest-2144281134 None] Group tempest-GroupsTest-Group-595376200: created successfully Jun 27 20:00:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1aed9875-4e56-49d7-98d3-3d65c546a660 tempest-GroupsTest-2144281134 None] Create group completed successfully. Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Flow 'volume_create_manager' (a86e8d17-d601-4adb-87ff-843561a45a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f6608-0322-4964-9bca-8f819611520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f6608-0322-4964-9bca-8f819611520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-636789061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b20e697-fd67-4e61-a793-5772c39aa671,host='devstack@QuobyteHD#QuobyteHD',id=faaa7a44-2f5d-4409-b437-b0a52e7af529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540021debc784d9f99f49940377cc6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:23Z,use_quota=True,user_id='c909b7675f9e4a7ead51422da4da2bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(778078c8-c316-4394-bc0e-29f90929e0d6),volume_type_id=778078c8-c316-4394-bc0e-29f90929e0d6)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef231d0-1f43-44bd-93da-4b844c0ee033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef231d0-1f43-44bd-93da-4b844c0ee033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb8f049-637c-4199-83b4-245b70ae7cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb8f049-637c-4199-83b4-245b70ae7cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faaa7a44-2f5d-4409-b437-b0a52e7af529', 'volume_name': 'volume-faaa7a44-2f5d-4409-b437-b0a52e7af529', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5a985-5385-4247-b533-f989016b9854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5a985-5385-4247-b533-f989016b9854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0053d9ab-ae59-4e1a-a9e3-40078ebb414c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:23 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Volume faaa7a44-2f5d-4409-b437-b0a52e7af529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faaa7a44-2f5d-4409-b437-b0a52e7af529', 'volume_size': 1} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f" returned: 0 in 5.561s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3739af55-749a-4c9b-95b0-8b3c1c4207aa]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:23 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:23 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:24 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 0.921s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:24 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:00:24 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Converted 1024.00 MB image at 184.11 MB/s Jun 27 20:00:24 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:00:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:24 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f Jun 27 20:00:24 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:25 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f" returned: 0 in 0.632s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-74a2e402-543c-4c18-8f1b-8fade9cdf06f" released by "_copy_volume_from_snapshot" :: held 9.120s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7-74a2e402-543c-4c18-8f1b-8fade9cdf06f" released by "_create_volume_from_snapshot" :: held 9.166s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.203s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.329s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2123607783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259666b1-2da5-43fa-9960-80453a1d596b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='379645a18cf64fea8bf75d38e0d134c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:18Z,use_quota=True,user_id='144d8b15238348e998504936f3469105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Creating volume 259666b1-2da5-43fa-9960-80453a1d596b {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:25 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:25 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b 1073741824 Jun 27 20:00:25 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4b723ebe-1a69-4baa-91bd-9a20a2ea24d0 tempest-GroupSnapshotsTest-296585406 None] Create group from source-snapshot-97f81186-5791-477c-90f7-32f415e27785 completed successfully. Jun 27 20:00:25 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b 1073741824" returned: 0 in 0.855s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:25 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b Jun 27 20:00:25 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-74a2e402-543c-4c18-8f1b-8fade9cdf06f" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-74a2e402-543c-4c18-8f1b-8fade9cdf06f" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab48e65-18cc-4558-94ee-f843affa8b08]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:26 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f Jun 27 20:00:26 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:26 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b" returned: 0 in 0.654s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.192s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-55913134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfe381d-7809-4dcc-8cee-02e9b22d4e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3acac4d902413c9025872583006912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:18Z,use_quota=True,user_id='991817ca88e1499d9739888af39f75e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Creating volume 5cfe381d-7809-4dcc-8cee-02e9b22d4e64 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:26 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:26 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 1073741824 Jun 27 20:00:26 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6101e2f-a198-4b97-ab65-1526ca2bb90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259666b1-2da5-43fa-9960-80453a1d596b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9089ce25-b5aa-46c2-88bc-510b26af8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:26 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Volume volume-259666b1-2da5-43fa-9960-80453a1d596b (259666b1-2da5-43fa-9960-80453a1d596b): created successfully Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9089ce25-b5aa-46c2-88bc-510b26af8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Flow 'volume_create_manager' (baee1c37-12bc-4ab2-b841-883ffbf937a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:26 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ba359122-58a0-47af-8fd2-e3597ca640a6 tempest-VolumesTestJSON-2106246446 None] Created volume successfully. Jun 27 20:00:27 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f" returned: 0 in 0.763s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:27 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f Jun 27 20:00:27 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:27 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 1073741824" returned: 0 in 0.860s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:27 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 Jun 27 20:00:27 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:27 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-74a2e402-543c-4c18-8f1b-8fade9cdf06f" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-74a2e402-543c-4c18-8f1b-8fade9cdf06f" released by "delete_volume" :: held 1.488s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Created reservations ['3069796d-db4d-4747-b453-1faedb995f05'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:27 devstack cinder-volume[93503]: WARNING cinder.quota [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-804915942 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-804915942, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:27 devstack cinder-volume[93503]: WARNING cinder.quota [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-804915942 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-804915942, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Created reservations ['5e174205-3ff5-42d1-b7f0-4e4686558169', 'dd4402f6-34fd-49b4-b0a3-95f89349d010', 'c63a393b-26ba-4bae-9869-3df33c0df3ce', '79968790-8df0-4250-aaf3-d77aee5a28e2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:28 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:28 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:28 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64" returned: 0 in 0.737s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.847s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b20e697-fd67-4e61-a793-5772c39aa671,created_at=2026-06-27T18:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-636789061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b20e697-fd67-4e61-a793-5772c39aa671,host='devstack@QuobyteHD#QuobyteHD',id=faaa7a44-2f5d-4409-b437-b0a52e7af529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540021debc784d9f99f49940377cc6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:23Z,use_quota=True,user_id='c909b7675f9e4a7ead51422da4da2bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(778078c8-c316-4394-bc0e-29f90929e0d6),volume_type_id=778078c8-c316-4394-bc0e-29f90929e0d6)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Creating volume faaa7a44-2f5d-4409-b437-b0a52e7af529 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:28 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:28 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 1073741824 Jun 27 20:00:28 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3302b7-496f-4b6b-a2f2-0ac022b0f00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66d7b78-b41d-4c99-a4fb-68ff6feb04d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:28 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Volume volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 (5cfe381d-7809-4dcc-8cee-02e9b22d4e64): created successfully Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66d7b78-b41d-4c99-a4fb-68ff6feb04d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Flow 'volume_create_manager' (bbc1122f-500c-46b0-8438-ae0a54b43a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-84079911-5a9d-4a7a-9c34-d92a26a66259 tempest-VolumesTransfersTest-376809210 None] Created volume successfully. Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Flow 'volume_create_manager' (ab0f4db2-dd56-497a-96c3-667a5adbb8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4e21a6-6139-44c9-ba93-ef744e3ad84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4e21a6-6139-44c9-ba93-ef744e3ad84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-474719202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a5dd5b-15d9-49b9-994c-2da4f1aff510,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='379645a18cf64fea8bf75d38e0d134c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:28Z,use_quota=True,user_id='144d8b15238348e998504936f3469105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52684a8e-b347-448b-878c-e7db379a7999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52684a8e-b347-448b-878c-e7db379a7999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7fab98-3d0c-4368-9998-cfc6cef6bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7fab98-3d0c-4368-9998-cfc6cef6bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a5dd5b-15d9-49b9-994c-2da4f1aff510', 'volume_name': 'volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878bb9e6-0ea1-4e64-a54f-b1ff2dfc30a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878bb9e6-0ea1-4e64-a54f-b1ff2dfc30a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a722e4-a503-476b-848d-24202173fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:28 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Volume 42a5dd5b-15d9-49b9-994c-2da4f1aff510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510', 'volume_size': 1} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 97f81186-5791-477c-90f7-32f415e27785: deleting Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 97f81186-5791-477c-90f7-32f415e27785: deleting {{(pid=93503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-5d44c43a-9656-443d-8eaa-451fed3ed86a" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-5d44c43a-9656-443d-8eaa-451fed3ed86a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:28 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.754s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Deleting offline snapshot b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 of volume 5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] snapshot_file for this snap is: volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:00:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c9544cc6-4b85-4b0e-8aa6-508f5104a1aa tempest-GroupSnapshotsTest-296585406 None] Delete group completed successfully. Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c1c3d-2525-4217-81c2-7b92cdf94164]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:28 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 Jun 27 20:00:28 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:29 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 1073741824" returned: 0 in 0.885s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:29 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 Jun 27 20:00:29 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:29 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" returned: 0 in 0.824s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d44c43a-9656-443d-8eaa-451fed3ed86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8011f2-4601-4ae5-a59f-fb95e8c1feb0]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Acquiring lock "cinder-5cfe381d-7809-4dcc-8cee-02e9b22d4e64-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-5cfe381d-7809-4dcc-8cee-02e9b22d4e64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Acquiring lock "cinder-quobyte-5cfe381d-7809-4dcc-8cee-02e9b22d4e64" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:29 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:29 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-quobyte-5cfe381d-7809-4dcc-8cee-02e9b22d4e64" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e629da7-e754-433d-93cb-25b824f31e80]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:29 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529" returned: 0 in 0.731s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:29 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 Jun 27 20:00:29 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-474719202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a5dd5b-15d9-49b9-994c-2da4f1aff510,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='379645a18cf64fea8bf75d38e0d134c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:28Z,use_quota=True,user_id='144d8b15238348e998504936f3469105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Creating volume 42a5dd5b-15d9-49b9-994c-2da4f1aff510 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:29 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:29 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 1073741824 Jun 27 20:00:29 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0053d9ab-ae59-4e1a-a9e3-40078ebb414c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faaa7a44-2f5d-4409-b437-b0a52e7af529', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b8cd55-f969-462f-ad04-45631035ff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:30 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Volume volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 (faaa7a44-2f5d-4409-b437-b0a52e7af529): created successfully Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b8cd55-f969-462f-ad04-45631035ff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Flow 'volume_create_manager' (a86e8d17-d601-4adb-87ff-843561a45a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:30 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-31ec9afc-b38e-48bc-8f32-9a7cd6f76efb tempest-GroupsTest-2144281134 None] Created volume successfully. Jun 27 20:00:30 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 0.866s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:30 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 Jun 27 20:00:30 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:30 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64" returned: 0 in 0.870s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:30 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64 Jun 27 20:00:30 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:30 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 1073741824" returned: 0 in 0.875s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:30 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 Jun 27 20:00:30 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Flow 'volume_create_manager' (f5a66803-6d7b-4a40-bd04-d6e329410fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d2b7f7-993b-4326-9e13-104f2a0c8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d2b7f7-993b-4326-9e13-104f2a0c8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-748964283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b20e697-fd67-4e61-a793-5772c39aa671,host='devstack@QuobyteHD#QuobyteHD',id=3e8185b3-3756-42f2-9a11-0afd4db20efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540021debc784d9f99f49940377cc6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:31Z,use_quota=True,user_id='c909b7675f9e4a7ead51422da4da2bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(778078c8-c316-4394-bc0e-29f90929e0d6),volume_type_id=778078c8-c316-4394-bc0e-29f90929e0d6)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17807fd4-6629-430a-b567-393b6e36bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17807fd4-6629-430a-b567-393b6e36bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922535be-cfa2-4116-8856-a9ba61181089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922535be-cfa2-4116-8856-a9ba61181089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8185b3-3756-42f2-9a11-0afd4db20efb', 'volume_name': 'volume-3e8185b3-3756-42f2-9a11-0afd4db20efb', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd7da0a-703c-468e-ab97-18af57dee0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd7da0a-703c-468e-ab97-18af57dee0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6ec03c-07a3-4ff8-8a80-620bd25c7f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:31 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Volume 3e8185b3-3756-42f2-9a11-0afd4db20efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8185b3-3756-42f2-9a11-0afd4db20efb', 'volume_size': 1} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:31 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" returned: 0 in 0.897s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:31 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7 Jun 27 20:00:31 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:31 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5cfe381d-7809-4dcc-8cee-02e9b22d4e64" returned: 0 in 0.876s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-quobyte-5cfe381d-7809-4dcc-8cee-02e9b22d4e64" released by "delete_volume" :: held 1.789s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:31 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510" returned: 0 in 0.751s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b20e697-fd67-4e61-a793-5772c39aa671,created_at=2026-06-27T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-748964283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b20e697-fd67-4e61-a793-5772c39aa671,host='devstack@QuobyteHD#QuobyteHD',id=3e8185b3-3756-42f2-9a11-0afd4db20efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540021debc784d9f99f49940377cc6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:31Z,use_quota=True,user_id='c909b7675f9e4a7ead51422da4da2bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(778078c8-c316-4394-bc0e-29f90929e0d6),volume_type_id=778078c8-c316-4394-bc0e-29f90929e0d6)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Creating volume 3e8185b3-3756-42f2-9a11-0afd4db20efb {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:31 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Created reservations ['f2035988-5c7f-4589-b784-ae01d0e0f0d5', '31ca9182-5ae9-4597-a3e4-f09adc58378e', '98672271-8417-4ff3-82d7-996c51effbe0', '90e27dfd-3420-46e9-ac27-2f6b7fa0ba69'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:31 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb 1073741824 Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a722e4-a503-476b-848d-24202173fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:31 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b578fb-0092-4d3a-acc1-58c569bf4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:31 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Volume volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 (42a5dd5b-15d9-49b9-994c-2da4f1aff510): created successfully Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b578fb-0092-4d3a-acc1-58c569bf4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Flow 'volume_create_manager' (ab0f4db2-dd56-497a-96c3-667a5adbb8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-19ce9903-9788-47fc-87d8-fda48e7cbc5e tempest-VolumesTestJSON-2106246446 None] Created volume successfully. Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:31 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:31 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:32 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a.b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" returned: 0 in 0.713s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-b9e7c85f-fa7e-4b73-89a3-53fbfcec35b7" released by "_delete_snapshot" :: held 3.420s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-5d44c43a-9656-443d-8eaa-451fed3ed86a" released by "delete_snapshot" :: held 3.456s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:32 devstack cinder-volume[93503]: WARNING cinder.quota [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-804915942 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-804915942, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['638105ab-3058-4769-8f81-81f005caeed7', 'c7e68ee6-5cfd-49ee-b96f-c96d663e3300', 'd71ad54f-6fa7-4adf-86ea-be1aa9d8e6e9', '682284b4-93ee-46fc-a9f8-4dacd43783c2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-341b66b0-6081-4d63-9dd2-a0944b01edd8 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 97f81186-5791-477c-90f7-32f415e27785: deleted successfully Jun 27 20:00:32 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.822s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:32 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Deleted volume successfully. Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb 1073741824" returned: 0 in 0.954s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2448ca17-1fbb-41dc-92fe-aede953ca9cd tempest-VolumesTransfersTest-1036722199 None] Lock "cinder-5cfe381d-7809-4dcc-8cee-02e9b22d4e64-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:32 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb Jun 27 20:00:32 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:33 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb" returned: 0 in 0.686s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6ec03c-07a3-4ff8-8a80-620bd25c7f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8185b3-3756-42f2-9a11-0afd4db20efb', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8001220d-e281-49d0-93a5-4513b6f00c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:33 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Volume volume-3e8185b3-3756-42f2-9a11-0afd4db20efb (3e8185b3-3756-42f2-9a11-0afd4db20efb): created successfully Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8001220d-e281-49d0-93a5-4513b6f00c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Flow 'volume_create_manager' (f5a66803-6d7b-4a40-bd04-d6e329410fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-93394677-dae9-4108-9edd-73d0bebc962e tempest-GroupsTest-2144281134 None] Created volume successfully. Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-5d44c43a-9656-443d-8eaa-451fed3ed86a" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-5d44c43a-9656-443d-8eaa-451fed3ed86a" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b2ff9-aaf5-4a66-a375-2167a90a243a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:33 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:33 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-aad389fe-7116-48fc-b14c-b63fe6edb705 tempest-GroupsTest-2144281134 None] Update group completed successfully. Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "cinder-42a5dd5b-15d9-49b9-994c-2da4f1aff510-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Lock "cinder-42a5dd5b-15d9-49b9-994c-2da4f1aff510-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "cinder-quobyte-42a5dd5b-15d9-49b9-994c-2da4f1aff510" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Lock "cinder-quobyte-42a5dd5b-15d9-49b9-994c-2da4f1aff510" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07005d9-8ae5-4fe6-a8b3-d351fabe7fb6]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:34 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 Jun 27 20:00:34 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:34 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 0.929s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:34 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a Jun 27 20:00:34 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:35 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510" returned: 0 in 0.909s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:35 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510 Jun 27 20:00:35 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:35 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d44c43a-9656-443d-8eaa-451fed3ed86a" returned: 0 in 0.838s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-5d44c43a-9656-443d-8eaa-451fed3ed86a" released by "delete_volume" :: held 1.875s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['df3ee8d9-cb10-4668-bb16-158f112efac6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:35 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6907c764-1c29-426e-a213-61b8aa79f9da tempest-GroupsTest-2144281134 None] Update group completed successfully. Jun 27 20:00:35 devstack cinder-volume[93503]: WARNING cinder.db.api [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-804915942'] Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['5192a65e-485e-4cbc-9a44-dffb006825e9', '908dab22-b3fd-4eda-9661-94b1ff27bdb8', '80928b98-ef30-4cee-9fb2-b6e008ff7a9c', 'c83c54ad-801c-4b79-9ab8-bd3cc3b7f51c'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:35 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:35 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:35 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-42a5dd5b-15d9-49b9-994c-2da4f1aff510" returned: 0 in 0.807s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Lock "cinder-quobyte-42a5dd5b-15d9-49b9-994c-2da4f1aff510" released by "delete_volume" :: held 1.765s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=145,cinder:UPDATE=168,cinder:INSERT=41,cinder:DELETE=11 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=149,cinder:INSERT=39,cinder:UPDATE=181,cinder:DELETE=11 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:00:35 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Created reservations ['54dc6be9-4c50-4945-8f25-2fe2e9947d7f', '46971295-bd1f-4447-8bb3-72281c697b58', '689a7e66-cd55-41ba-9eae-d1b689b038c5', '8db5c2c7-9f09-4d55-9774-85aec2291c9c'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:36 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:36 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Acquiring lock "cinder-259666b1-2da5-43fa-9960-80453a1d596b-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Lock "cinder-259666b1-2da5-43fa-9960-80453a1d596b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Acquiring lock "cinder-quobyte-259666b1-2da5-43fa-9960-80453a1d596b" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Lock "cinder-quobyte-259666b1-2da5-43fa-9960-80453a1d596b" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf997eb-eced-402a-a7e7-f2ad383a7481]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6f65dba8-eba7-49a9-8d5a-70417dfe9e32 tempest-GroupSnapshotsTest-296585406 None] Group tempest-GroupSnapshotsTest-Group-1861941476: creating Jun 27 20:00:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6f65dba8-eba7-49a9-8d5a-70417dfe9e32 tempest-GroupSnapshotsTest-296585406 None] Group tempest-GroupSnapshotsTest-Group-1861941476: created successfully Jun 27 20:00:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6f65dba8-eba7-49a9-8d5a-70417dfe9e32 tempest-GroupSnapshotsTest-296585406 None] Create group completed successfully. Jun 27 20:00:36 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.994s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:36 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c38f6e7c-5ef1-4e53-a79f-329af2ab4d24 tempest-GroupSnapshotsTest-296585406 None] Delete group completed successfully. Jun 27 20:00:36 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b Jun 27 20:00:36 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:37 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.031s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Deleted volume successfully. Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8377dbb0-4f8c-4430-916f-0871648d1ef3 tempest-VolumesTestJSON-2106246446 None] Lock "cinder-42a5dd5b-15d9-49b9-994c-2da4f1aff510-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Acquiring lock "cinder-quobyte-3e8185b3-3756-42f2-9a11-0afd4db20efb" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Lock "cinder-quobyte-3e8185b3-3756-42f2-9a11-0afd4db20efb" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec95b4b-762e-43f3-9005-7c2c7cb076c5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:37 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb Jun 27 20:00:37 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:37 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b" returned: 0 in 1.070s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:37 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b Jun 27 20:00:37 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (70371675-4c0b-4a90-91f3-f40e51bf88ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c29fced-845e-472d-aaa2-bf7bfc131c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c29fced-845e-472d-aaa2-bf7bfc131c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120694066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f52cdc-59d4-4a26-b3d9-30bfb3cd4759,host='devstack@QuobyteHD#QuobyteHD',id=4cebc38d-fde3-437f-aec2-2ea51d764be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:38Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa00f09a-0f4a-45c3-939c-3a3572ce4269),volume_type_id=fa00f09a-0f4a-45c3-939c-3a3572ce4269)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:38 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d9cb66-c633-465c-839a-0cb6d2163611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d9cb66-c633-465c-839a-0cb6d2163611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2ee415-cf9a-4541-985e-65264ff2193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2ee415-cf9a-4541-985e-65264ff2193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cebc38d-fde3-437f-aec2-2ea51d764be5', 'volume_name': 'volume-4cebc38d-fde3-437f-aec2-2ea51d764be5', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4d0f80-d0d4-4398-93e6-abac9ceb1ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4d0f80-d0d4-4398-93e6-abac9ceb1ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9f901b-4de6-40de-9bfc-5d50f03e8e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Volume 4cebc38d-fde3-437f-aec2-2ea51d764be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cebc38d-fde3-437f-aec2-2ea51d764be5', 'volume_size': 1} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8f52cdc-59d4-4a26-b3d9-30bfb3cd4759,created_at=2026-06-27T18:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120694066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f52cdc-59d4-4a26-b3d9-30bfb3cd4759,host='devstack@QuobyteHD#QuobyteHD',id=4cebc38d-fde3-437f-aec2-2ea51d764be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:38Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa00f09a-0f4a-45c3-939c-3a3572ce4269),volume_type_id=fa00f09a-0f4a-45c3-939c-3a3572ce4269)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Creating volume 4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:38 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb" returned: 0 in 1.052s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:38 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 1073741824 Jun 27 20:00:38 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:38 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb Jun 27 20:00:38 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:38 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-259666b1-2da5-43fa-9960-80453a1d596b" returned: 0 in 0.879s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Lock "cinder-quobyte-259666b1-2da5-43fa-9960-80453a1d596b" released by "delete_volume" :: held 2.027s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Created reservations ['40233eec-508b-4bf9-b8bc-43f05a7a8702', 'cb402d00-4afd-4ef5-89e9-93a84dc2fe98', '12e1cd79-037d-45b8-8579-2ec666fc8be8', '090b43fa-8ee2-41f9-86c2-64d49d2488bc'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:38 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:38 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:39 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e8185b3-3756-42f2-9a11-0afd4db20efb" returned: 0 in 0.864s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Lock "cinder-quobyte-3e8185b3-3756-42f2-9a11-0afd4db20efb" released by "delete_volume" :: held 1.973s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Acquiring lock "cinder-quobyte-faaa7a44-2f5d-4409-b437-b0a52e7af529" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Lock "cinder-quobyte-faaa7a44-2f5d-4409-b437-b0a52e7af529" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5e4c0-c082-48fb-a658-4becc0bb54a4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:39 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 Jun 27 20:00:39 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:39 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.848s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Deleted volume successfully. Jun 27 20:00:39 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 1073741824" returned: 0 in 1.284s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a5988595-9b04-4277-85df-d03cdf7ede2c tempest-VolumesTestJSON-2106246446 None] Lock "cinder-259666b1-2da5-43fa-9960-80453a1d596b-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:39 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 Jun 27 20:00:39 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Acquiring lock "cinder-9ab13eb5-393c-411b-bdf2-a2673a000186-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Lock "cinder-9ab13eb5-393c-411b-bdf2-a2673a000186-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Acquiring lock "cinder-quobyte-9ab13eb5-393c-411b-bdf2-a2673a000186" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:00:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Lock "cinder-quobyte-9ab13eb5-393c-411b-bdf2-a2673a000186" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[71945b7b-ad9f-4318-b889-2c595bd24a77]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:40 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 Jun 27 20:00:40 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:40 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529" returned: 0 in 1.066s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:40 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529 Jun 27 20:00:40 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:40 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5" returned: 0 in 0.772s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9f901b-4de6-40de-9bfc-5d50f03e8e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cebc38d-fde3-437f-aec2-2ea51d764be5', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c2fa7d-16f5-4f07-8b56-023bc83e6bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:40 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Volume volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 (4cebc38d-fde3-437f-aec2-2ea51d764be5): created successfully Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c2fa7d-16f5-4f07-8b56-023bc83e6bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (70371675-4c0b-4a90-91f3-f40e51bf88ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e520e84a-ac04-43f8-869e-c3498d5ecc4b tempest-GroupSnapshotsTest-296585406 None] Created volume successfully. Jun 27 20:00:40 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186" returned: 0 in 0.898s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:40 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186 Jun 27 20:00:40 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:41 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-faaa7a44-2f5d-4409-b437-b0a52e7af529" returned: 0 in 0.808s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Lock "cinder-quobyte-faaa7a44-2f5d-4409-b437-b0a52e7af529" released by "delete_volume" :: held 1.940s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Created reservations ['6b4ec3ff-1931-4e1f-a83d-43258ff8fdfc'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:41 devstack cinder-volume[93503]: WARNING cinder.quota [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-894829181 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-894829181, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:41 devstack cinder-volume[93503]: WARNING cinder.quota [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-894829181 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-894829181, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Created reservations ['aed7babf-d976-4cad-8b8c-01cc470ce10c', '89229100-9881-4e7c-8ede-405737e1125e', '39cb138d-69e4-4d63-b336-179c442a52d8', '8d8785a0-a020-4c65-b147-8b086dee33a5'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Created reservations ['61248bc3-cb1d-4b2d-8e54-c65835b8c3fc', '00bbeab6-3595-4ead-b748-ec54038d759f', '78df9cb6-202d-4a6f-b22c-e98cb8e17d5c', '8156f4aa-a501-4435-b74e-4e4ab5a36d24'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (18654ae2-67e2-49f3-9215-50bfd1ec1c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8837a8-a79e-4933-8d20-25d50b1283e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8837a8-a79e-4933-8d20-25d50b1283e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492457940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f52cdc-59d4-4a26-b3d9-30bfb3cd4759,host='devstack@QuobyteHD#QuobyteHD',id=60e11365-a5f1-4923-9bef-ee22fc80ff2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:42Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa00f09a-0f4a-45c3-939c-3a3572ce4269),volume_type_id=fa00f09a-0f4a-45c3-939c-3a3572ce4269)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff4cd0-bca5-462a-bfdf-51dc78861eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff4cd0-bca5-462a-bfdf-51dc78861eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dad52cc-dd44-4b1a-88af-87a6abba35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dad52cc-dd44-4b1a-88af-87a6abba35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e11365-a5f1-4923-9bef-ee22fc80ff2f', 'volume_name': 'volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5772fbeb-02cc-46a9-b462-7597c07556d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5772fbeb-02cc-46a9-b462-7597c07556d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d65ee7-73d2-4d8d-9d78-bb9fc57efd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:41 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Volume 60e11365-a5f1-4923-9bef-ee22fc80ff2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f', 'volume_size': 1} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8f52cdc-59d4-4a26-b3d9-30bfb3cd4759,created_at=2026-06-27T18:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492457940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f52cdc-59d4-4a26-b3d9-30bfb3cd4759,host='devstack@QuobyteHD#QuobyteHD',id=60e11365-a5f1-4923-9bef-ee22fc80ff2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:42Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa00f09a-0f4a-45c3-939c-3a3572ce4269),volume_type_id=fa00f09a-0f4a-45c3-939c-3a3572ce4269)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Creating volume 60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:41 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:41 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9ab13eb5-393c-411b-bdf2-a2673a000186" returned: 0 in 0.858s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:41 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f 1073741824 Jun 27 20:00:41 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Lock "cinder-quobyte-9ab13eb5-393c-411b-bdf2-a2673a000186" released by "delete_volume" :: held 1.816s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Created reservations ['858d0e18-70dc-4e21-8aa9-e7a46c681494', '9db340c5-71c7-4e56-8c4d-4c654859bad4', '656c6083-be82-476c-b935-babb581431f3', '26fda676-2f76-4164-a50f-5097bcdb8472'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:00:41 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:41 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:42 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:00:42 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:43 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.149s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:43 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-cccf8b4d-8024-411d-8ae3-02bc787a809f tempest-GroupsTest-2144281134 None] Delete group completed successfully. Jun 27 20:00:43 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f 1073741824" returned: 0 in 1.380s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:43 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.195s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:00:43 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Deleted volume successfully. Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:43 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f0181bab-118d-477f-a053-39425fc933ee tempest-VolumesTestJSON-2106246446 None] Lock "cinder-9ab13eb5-393c-411b-bdf2-a2673a000186-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:00:43 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f Jun 27 20:00:43 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:43 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f" returned: 0 in 0.812s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] <== create_volume: return (2261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d65ee7-73d2-4d8d-9d78-bb9fc57efd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324ad482-cec6-46e1-a120-6ef0b57f2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:44 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Volume volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f (60e11365-a5f1-4923-9bef-ee22fc80ff2f): created successfully Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324ad482-cec6-46e1-a120-6ef0b57f2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (18654ae2-67e2-49f3-9215-50bfd1ec1c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-174937d3-ef1d-4e13-a15e-1775201eb4a6 tempest-GroupSnapshotsTest-296585406 None] Created volume successfully. Jun 27 20:00:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8fa44849-caab-4809-9722-3b87f3160a7f tempest-GroupSnapshotsTest-296585406 None] Update group completed successfully. Jun 27 20:00:46 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dfd4dd02-93e1-4f46-bfe7-04c25c537568 tempest-GroupSnapshotsTest-296585406 None] Update group completed successfully. Jun 27 20:00:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5bfcf1fe-8ead-4315-9975-72ccb6018aad tempest-GroupSnapshotsTest-296585406 None] Update group completed successfully. Jun 27 20:00:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-84c3e72e-2a95-4d12-9e31-865663718cdb tempest-GroupSnapshotsV319Test-177938893 None] Group tempest-GroupSnapshotsV319Test-Group-393094716: creating Jun 27 20:00:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-84c3e72e-2a95-4d12-9e31-865663718cdb tempest-GroupSnapshotsV319Test-177938893 None] Group tempest-GroupSnapshotsV319Test-Group-393094716: created successfully Jun 27 20:00:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-84c3e72e-2a95-4d12-9e31-865663718cdb tempest-GroupSnapshotsV319Test-177938893 None] Create group completed successfully. Jun 27 20:00:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-da7a98c7-f4a1-49f1-90dd-c14e503f81c7 tempest-GroupSnapshotsTest-296585406 None] Update group completed successfully. Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Flow 'volume_create_manager' (9e13397a-caae-41c1-ba87-adeafe04d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c9e081-014f-4a85-b62c-38edb8dbd705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c9e081-014f-4a85-b62c-38edb8dbd705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424557279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e2620d3-9511-46d2-8fdc-6e77d07e5306,host='devstack@QuobyteHD#QuobyteHD',id=727d5095-414c-4baf-a990-e2d40979b71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a9f642783422eb9d1f748ef579f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:50Z,use_quota=True,user_id='f62f8bd4080e4941aa57205edfff8d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce2a8f2-d558-44de-a197-bb70e23779c8),volume_type_id=4ce2a8f2-d558-44de-a197-bb70e23779c8)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e11615e-1e99-4f7e-bc61-ad4df0b00935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e11615e-1e99-4f7e-bc61-ad4df0b00935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe71cbff-55f7-4a2f-bc1f-49f6b01f1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe71cbff-55f7-4a2f-bc1f-49f6b01f1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727d5095-414c-4baf-a990-e2d40979b71d', 'volume_name': 'volume-727d5095-414c-4baf-a990-e2d40979b71d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefa6ae5-d4e0-4aec-9eaf-4a30e2a7a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefa6ae5-d4e0-4aec-9eaf-4a30e2a7a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76539eb-e5bd-4ad6-abe8-ceccbe0e9db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:50 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Volume 727d5095-414c-4baf-a990-e2d40979b71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727d5095-414c-4baf-a990-e2d40979b71d', 'volume_size': 1} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e2620d3-9511-46d2-8fdc-6e77d07e5306,created_at=2026-06-27T18:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424557279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e2620d3-9511-46d2-8fdc-6e77d07e5306,host='devstack@QuobyteHD#QuobyteHD',id=727d5095-414c-4baf-a990-e2d40979b71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46a9f642783422eb9d1f748ef579f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:50Z,use_quota=True,user_id='f62f8bd4080e4941aa57205edfff8d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce2a8f2-d558-44de-a197-bb70e23779c8),volume_type_id=4ce2a8f2-d558-44de-a197-bb70e23779c8)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Creating volume 727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:50 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:50 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d 1073741824 Jun 27 20:00:50 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (33fe0e92-7420-474a-8b5b-d3abe27b8a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542a07ff-ced1-4f7e-8640-442222aaf984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542a07ff-ced1-4f7e-8640-442222aaf984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-648774949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7127819-e08c-45e9-b067-4cfec7c1dbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:51Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cb851a-5946-4436-b612-dea25a314bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cb851a-5946-4436-b612-dea25a314bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a00f7b-f9a3-4b6b-acfc-2ac5e4cc5b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a00f7b-f9a3-4b6b-acfc-2ac5e4cc5b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7127819-e08c-45e9-b067-4cfec7c1dbf9', 'volume_name': 'volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8121dfa-ddca-40f6-bef8-af23f0a9ae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8121dfa-ddca-40f6-bef8-af23f0a9ae23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630e5a64-4a45-4713-971c-4fa3b2a84c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Volume e7127819-e08c-45e9-b067-4cfec7c1dbf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9', 'volume_size': 1} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Flow 'volume_create_manager' (e0452829-ab10-458e-9e8b-e66868499e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d2aa19-c8d0-4f03-93c8-b3401ebda833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d2aa19-c8d0-4f03-93c8-b3401ebda833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1308478537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefe884b-bace-4070-b0c7-57af7d6c1dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1039db64084ca4ad8bdbb003fe2ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:51Z,use_quota=True,user_id='c9ffe5b5a26243b5942121e05468ce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7db38c-8f6c-4e1b-b667-38f8b58af3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7db38c-8f6c-4e1b-b667-38f8b58af3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df2779d-a38e-4207-96f9-189f28f0f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df2779d-a38e-4207-96f9-189f28f0f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cefe884b-bace-4070-b0c7-57af7d6c1dd6', 'volume_name': 'volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76598201-cec6-41d3-b565-a2c966283c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76598201-cec6-41d3-b565-a2c966283c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e414f03-b637-4ec9-a57c-9f2480fdb0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Volume cefe884b-bace-4070-b0c7-57af7d6c1dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6', 'volume_size': 1} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] GroupSnapshot 359749fa-1b84-4aef-ac3e-18b9f31887a3: creating. Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d 1073741824" returned: 0 in 1.031s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Group snapshot 359749fa-1b84-4aef-ac3e-18b9f31887a3: creating. {{(pid=93503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:51 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d Jun 27 20:00:51 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:52 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d" returned: 0 in 0.663s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-648774949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7127819-e08c-45e9-b067-4cfec7c1dbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:51Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Creating volume e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:52 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76539eb-e5bd-4ad6-abe8-ceccbe0e9db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727d5095-414c-4baf-a990-e2d40979b71d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd648ff3-dcca-4478-9b53-0993b87c3962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:52 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 1073741824 Jun 27 20:00:52 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:52 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Volume volume-727d5095-414c-4baf-a990-e2d40979b71d (727d5095-414c-4baf-a990-e2d40979b71d): created successfully Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd648ff3-dcca-4478-9b53-0993b87c3962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Flow 'volume_create_manager' (9e13397a-caae-41c1-ba87-adeafe04d491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b8ffd47a-1c55-4a3f-9e51-7c6462943ed4 tempest-GroupSnapshotsV319Test-177938893 None] Created volume successfully. Jun 27 20:00:53 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 1073741824" returned: 0 in 0.790s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:53 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 Jun 27 20:00:53 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] GroupSnapshot 9d8ac18d-f6cf-4dca-9e22-be9295394294: creating. Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Group snapshot 9d8ac18d-f6cf-4dca-9e22-be9295394294: creating. {{(pid=93503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:53 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9" returned: 0 in 0.634s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1308478537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefe884b-bace-4070-b0c7-57af7d6c1dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1039db64084ca4ad8bdbb003fe2ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:00:51Z,use_quota=True,user_id='c9ffe5b5a26243b5942121e05468ce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Creating volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:00:53 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630e5a64-4a45-4713-971c-4fa3b2a84c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0713915-b91d-4017-b9d4-cd94908080ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:53 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 1073741824 Jun 27 20:00:53 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Volume volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 (e7127819-e08c-45e9-b067-4cfec7c1dbf9): created successfully Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0713915-b91d-4017-b9d4-cd94908080ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (33fe0e92-7420-474a-8b5b-d3abe27b8a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5dd3a3dc-47af-4357-a2d9-66b7e1e93bef tempest-VolumesSnapshotTestJSON-978396819 None] Created volume successfully. Jun 27 20:00:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:54 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 1073741824" returned: 0 in 0.902s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:54 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 Jun 27 20:00:54 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:55 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6" returned: 0 in 0.643s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.748s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e414f03-b637-4ec9-a57c-9f2480fdb0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b294e4-a889-40cf-8645-281b5189cda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Creating offline snapshot a0865445-e8cd-40d3-ae3e-4a49cc70c24c of volume 4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:00:55 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Volume volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 (cefe884b-bace-4070-b0c7-57af7d6c1dd6): created successfully Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b294e4-a889-40cf-8645-281b5189cda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Flow 'volume_create_manager' (e0452829-ab10-458e-9e8b-e66868499e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5767547-adeb-433e-b945-5d2ceda22dea]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-add59f97-6d81-48e1-ab7d-0ef5d1493b59 tempest-SnapshotsActionsTest-1709040113 None] Created volume successfully. Jun 27 20:00:55 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 Jun 27 20:00:55 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:56 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5" returned: 0 in 0.751s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:56 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c 1G Jun 27 20:00:56 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:56 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c 1G" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:56 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c Jun 27 20:00:56 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:57 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c" returned: 0 in 0.678s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:57 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:00:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:57 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c Jun 27 20:00:57 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:58 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c" returned: 0 in 0.654s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:58 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info Jun 27 20:00:58 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:58 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info" returned: 0 in 0.664s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:58 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:00:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:59 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info Jun 27 20:00:59 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:00:59 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.info" returned: 0 in 0.649s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Creating offline snapshot d81df0ed-391a-4b48-ae7b-676224fee086 of volume 60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16de5eb1-53ce-4949-8c4b-41a4d463bccb]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:00:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:00:59 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f Jun 27 20:00:59 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:00 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f" returned: 0 in 0.759s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:00 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 1G Jun 27 20:01:00 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:01 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 1G" returned: 0 in 0.793s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:01 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 Jun 27 20:01:01 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:01 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086" returned: 0 in 0.684s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:01 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:01:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:01 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 Jun 27 20:01:01 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:02 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086" returned: 0 in 0.633s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:02 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info Jun 27 20:01:02 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:03 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info" returned: 0 in 0.656s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:03 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:03 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info Jun 27 20:01:03 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:03 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.info" returned: 0 in 0.636s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.239s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.374s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Creating offline snapshot aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 of volume e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b7bfd6-260a-4f35-a5da-9d5d9e014a96]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bca6b99f-aa0a-4da9-a73d-d6ec09b50b52 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 359749fa-1b84-4aef-ac3e-18b9f31887a3: created successfully Jun 27 20:01:04 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 Jun 27 20:01:04 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:04 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9" returned: 0 in 0.766s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:04 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 1G Jun 27 20:01:04 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 359749fa-1b84-4aef-ac3e-18b9f31887a3: deleting Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 359749fa-1b84-4aef-ac3e-18b9f31887a3: deleting {{(pid=93503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-4cebc38d-fde3-437f-aec2-2ea51d764be5" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-4cebc38d-fde3-437f-aec2-2ea51d764be5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-a0865445-e8cd-40d3-ae3e-4a49cc70c24c" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-a0865445-e8cd-40d3-ae3e-4a49cc70c24c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Deleting offline snapshot a0865445-e8cd-40d3-ae3e-4a49cc70c24c of volume 4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] snapshot_file for this snap is: volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2030c-74f2-4979-8781-e24439e0ade1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:05 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c Jun 27 20:01:05 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:05 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 1G" returned: 0 in 0.873s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:05 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 Jun 27 20:01:05 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:06 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c" returned: 0 in 0.795s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cebc38d-fde3-437f-aec2-2ea51d764be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02a7b5e-2860-4be4-b6dd-ae6455da396b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:06 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 Jun 27 20:01:06 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:06 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" returned: 0 in 0.679s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:06 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 is being set with open permissions: ugo+rw Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:06 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 Jun 27 20:01:06 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:06 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5" returned: 0 in 0.770s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:06 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c Jun 27 20:01:06 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:06 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" returned: 0 in 0.625s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:06 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info Jun 27 20:01:06 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:07 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info" returned: 0 in 0.637s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:07 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info is being set with open permissions: ugo+rw Jun 27 20:01:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:07 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c" returned: 0 in 0.731s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:07 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info Jun 27 20:01:07 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:07 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c Jun 27 20:01:07 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:08 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.info" returned: 0 in 0.627s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.324s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.632s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Creating offline snapshot 6ab1d8b9-5d38-4c59-a43c-430332f0f186 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:08 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e20ba11-8629-4133-800f-e97e3de3d312]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5.a0865445-e8cd-40d3-ae3e-4a49cc70c24c" returned: 0 in 0.692s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-a0865445-e8cd-40d3-ae3e-4a49cc70c24c" released by "_delete_snapshot" :: held 3.098s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-4cebc38d-fde3-437f-aec2-2ea51d764be5" released by "delete_snapshot" :: held 3.127s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bcc8ba62-ffa6-4aa0-b222-8e4fab024ff4 tempest-VolumesSnapshotTestJSON-978396819 None] Create snapshot completed successfully Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-60e11365-a5f1-4923-9bef-ee22fc80ff2f" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-60e11365-a5f1-4923-9bef-ee22fc80ff2f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-d81df0ed-391a-4b48-ae7b-676224fee086" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:08 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 Jun 27 20:01:08 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-d81df0ed-391a-4b48-ae7b-676224fee086" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Deleting offline snapshot d81df0ed-391a-4b48-ae7b-676224fee086 of volume 60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] snapshot_file for this snap is: volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0984b17-cdc2-438c-9070-2cb3a930821f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:08 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 Jun 27 20:01:08 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:09 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:09 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 1G Jun 27 20:01:09 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-aa77fcb8-9a8d-48a6-8ae8-bf38135e0713-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:09 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086" returned: 0 in 0.821s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-aa77fcb8-9a8d-48a6-8ae8-bf38135e0713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b261f8b-048e-4f81-939e-3176911620f7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-e7127819-e08c-45e9-b067-4cfec7c1dbf9" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e7127819-e08c-45e9-b067-4cfec7c1dbf9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Deleting offline snapshot aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 of volume e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] snapshot_file for this snap is: volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb7c1f-4576-4df4-9abf-67c8bab3e150]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:09 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f Jun 27 20:01:09 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:09 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 Jun 27 20:01:09 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:09 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 1G" returned: 0 in 0.862s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:09 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:09 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:10 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f" returned: 0 in 0.830s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:10 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 Jun 27 20:01:10 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:10 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" returned: 0 in 0.792s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3e5cc-868d-4c17-a8df-f5f6e55d00f1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:10 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 Jun 27 20:01:10 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:10 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:10 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 is being set with open permissions: ugo+rw Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:10 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:10 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:10 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086" returned: 0 in 0.735s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:10 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086 Jun 27 20:01:10 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:10 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:11 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 Jun 27 20:01:11 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:11 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.696s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:11 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info Jun 27 20:01:11 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:11 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f.d81df0ed-391a-4b48-ae7b-676224fee086" returned: 0 in 0.642s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-d81df0ed-391a-4b48-ae7b-676224fee086" released by "_delete_snapshot" :: held 3.153s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-60e11365-a5f1-4923-9bef-ee22fc80ff2f" released by "delete_snapshot" :: held 3.175s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:11 devstack cinder-volume[93503]: WARNING cinder.quota [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1112938764 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1112938764, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:11 devstack cinder-volume[93503]: WARNING cinder.quota [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1112938764 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1112938764, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['d4dc9f89-84f2-4368-b6c6-b8bcbd688454', '12c23ae7-a218-47bd-8681-2b0ea80f0fad', 'cda516ba-b898-439e-87d2-7fee750e03e3', '18257f0c-9336-47b5-823d-10c1737d2e44'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['fa3d8e2f-3aca-4e54-8e32-1fae14bd6f39', '8ad4c3c4-2cce-4e33-8fd6-ec4981308898', '3dadbfe1-4fd6-42c9-99e6-6308c2c4bae7', '64ad3869-d219-4a9a-857c-c9f424fa36de'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:11 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" returned: 0 in 0.821s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-add7c422-fa3d-4cd3-9137-64c3126e2723 tempest-GroupSnapshotsTest-296585406 None] group_snapshot 359749fa-1b84-4aef-ac3e-18b9f31887a3: deleted successfully Jun 27 20:01:11 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713 Jun 27 20:01:11 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:11 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:11 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info is being set with open permissions: ugo+rw Jun 27 20:01:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:12 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info Jun 27 20:01:12 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:12 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9.aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" returned: 0 in 0.657s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-aa77fcb8-9a8d-48a6-8ae8-bf38135e0713" released by "_delete_snapshot" :: held 3.163s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e7127819-e08c-45e9-b067-4cfec7c1dbf9" released by "delete_snapshot" :: held 3.191s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['2c8edf00-42f5-4da8-a054-15bf29bfc1d3', 'e6cc9d64-fa68-4acd-919d-b0898ea4b3e8', '5f6745ab-1e94-480a-ac14-b5b54c5a1262', '7957b7c1-e667-4fb9-996c-6cf41c608a27'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:12 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Delete snapshot completed successfully. Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.info" returned: 0 in 0.652s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c23bc11-e5f3-4ab8-af50-d262fdb9f448 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-aa77fcb8-9a8d-48a6-8ae8-bf38135e0713-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 19.126s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Creating offline snapshot 31d2dd77-90f9-490e-836a-c22dfe126ee4 of volume 727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e3853a4e-4bcc-41f8-aead-f84b297d8c38 tempest-SnapshotsActionsTest-1709040113 None] Create snapshot completed successfully Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8303d89d-eab9-4290-b7de-42046d21ea62]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:12 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d Jun 27 20:01:12 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-4cebc38d-fde3-437f-aec2-2ea51d764be5" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-4cebc38d-fde3-437f-aec2-2ea51d764be5" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c36824-d5d2-4ba6-ae4b-b56478fc4a98]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:13 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 Jun 27 20:01:13 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:13 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d" returned: 0 in 0.857s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:13 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 1G Jun 27 20:01:13 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (b0817298-86b2-4104-9b06-3d196357d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a56119-aba1-4605-8ea9-df59fe106219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:14 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a56119-aba1-4605-8ea9-df59fe106219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29162457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:14Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b21342f-5568-447b-8091-75127d986ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b21342f-5568-447b-8091-75127d986ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c34eb86-2c78-43bd-89a8-396ce36194db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c34eb86-2c78-43bd-89a8-396ce36194db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83', 'volume_name': 'volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71842a7d-7c1d-434d-a7c7-8c489e73019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71842a7d-7c1d-434d-a7c7-8c489e73019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e3b1f0-7e1f-4bab-9589-5403e77fe88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:14 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Volume dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83', 'volume_size': 1} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5" returned: 0 in 0.908s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:14 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5 Jun 27 20:01:14 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:14 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 1G" returned: 0 in 0.927s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727d5095-414c-4baf-a990-e2d40979b71d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:14 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727d5095-414c-4baf-a990-e2d40979b71d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 Jun 27 20:01:14 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:14 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cebc38d-fde3-437f-aec2-2ea51d764be5" returned: 0 in 0.647s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-4cebc38d-fde3-437f-aec2-2ea51d764be5" released by "delete_volume" :: held 1.637s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-60e11365-a5f1-4923-9bef-ee22fc80ff2f" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-60e11365-a5f1-4923-9bef-ee22fc80ff2f" acquired by "delete_volume" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4af39c-21a0-416b-bb30-e9ff59063230]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:15 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f Jun 27 20:01:15 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:15 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727d5095-414c-4baf-a990-e2d40979b71d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4" returned: 0 in 0.703s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:15 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:01:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:15 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 Jun 27 20:01:15 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:15 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f" returned: 0 in 0.744s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:15 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f Jun 27 20:01:15 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:15 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4" returned: 0 in 0.631s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:15 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info Jun 27 20:01:15 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:16 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:16 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:16 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-60e11365-a5f1-4923-9bef-ee22fc80ff2f" returned: 0 in 0.627s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-60e11365-a5f1-4923-9bef-ee22fc80ff2f" released by "delete_volume" :: held 1.436s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['7d12f500-b467-4876-91c2-70a8e65f5896'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:16 devstack cinder-volume[93503]: WARNING cinder.quota [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1112938764 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1112938764, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['7d87939b-37cb-4a70-9cd9-3aaa241d6322', '0ea6bb17-4f70-4678-aa3f-5a0bcf4f02f6', 'bcb407ae-8a36-4424-8146-7809c9506442', '87c3b90e-7a58-44c2-921c-f38c2bfc22c4'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:16 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info" returned: 0 in 0.643s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:16 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:16 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info Jun 27 20:01:16 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['83600a60-716c-4a6b-a1f7-e16de87f0c78', '075da862-7897-4adb-9344-3cfc3e089f45', '6c506428-3abf-43be-a45a-6dac3a1bad4d', '6c187789-bede-4f8b-aea4-d255157b4d83'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:16 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:16 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:17 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:01:17 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.info" returned: 0 in 0.758s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.483s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Creating offline snapshot 04c61976-0d63-45b3-810d-6d858db30aa0 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1f20f46f-db96-483b-98da-a9a7606a133a tempest-GroupSnapshotsTest-296585406 None] Group tempest-GroupSnapshotsTest-Group-351703200: creating Jun 27 20:01:17 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.729s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b774ecac-dcc7-4b15-9e7f-2c4db49a8446]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-de6e6206-2536-4382-8ba3-c843244b9553 tempest-GroupSnapshotsTest-296585406 None] Delete group completed successfully. Jun 27 20:01:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1f20f46f-db96-483b-98da-a9a7606a133a tempest-GroupSnapshotsTest-296585406 None] Group tempest-GroupSnapshotsTest-Group-351703200: created successfully Jun 27 20:01:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1f20f46f-db96-483b-98da-a9a7606a133a tempest-GroupSnapshotsTest-296585406 None] Create group completed successfully. Jun 27 20:01:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-af13b34e-76a8-4e31-94fa-96b191aa4119 tempest-GroupSnapshotsV319Test-177938893 None] group_snapshot 9d8ac18d-f6cf-4dca-9e22-be9295394294: created successfully Jun 27 20:01:17 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:17 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:18 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.770s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:18 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 1G Jun 27 20:01:18 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:18 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] group_snapshot 9d8ac18d-f6cf-4dca-9e22-be9295394294: deleting Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] group_snapshot 9d8ac18d-f6cf-4dca-9e22-be9295394294: deleting {{(pid=93503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "cinder-quobyte-727d5095-414c-4baf-a990-e2d40979b71d" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Lock "cinder-quobyte-727d5095-414c-4baf-a990-e2d40979b71d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "cinder-quobyte-31d2dd77-90f9-490e-836a-c22dfe126ee4" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Lock "cinder-quobyte-31d2dd77-90f9-490e-836a-c22dfe126ee4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Deleting offline snapshot 31d2dd77-90f9-490e-836a-c22dfe126ee4 of volume 727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] snapshot_file for this snap is: volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5dfa47-ffa1-4829-a8e0-c9796f3837a5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (fc025e72-b83b-4672-9c40-ceda18b0205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb03539d-cfb8-434f-bf39-408d26826f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:19 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 Jun 27 20:01:19 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb03539d-cfb8-434f-bf39-408d26826f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975116909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=761ee680-df12-4fd9-a969-90ae223d46b5,host='devstack@QuobyteHD#QuobyteHD',id=f81711ce-dd6c-454e-ae6d-8c7686edac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:19Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9346788-6e17-4337-a6d9-d75c6513d348),volume_type_id=c9346788-6e17-4337-a6d9-d75c6513d348)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bac3926-4dbe-4170-a686-829019c27ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bac3926-4dbe-4170-a686-829019c27ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dd5647-525f-46f1-a18b-1333dc5dbc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dd5647-525f-46f1-a18b-1333dc5dbc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81711ce-dd6c-454e-ae6d-8c7686edac38', 'volume_name': 'volume-f81711ce-dd6c-454e-ae6d-8c7686edac38', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153ee562-cdf9-4670-adb2-63728f7cc065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153ee562-cdf9-4670-adb2-63728f7cc065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70297126-2153-4ccd-ac6d-e3a210669885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:19 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Volume f81711ce-dd6c-454e-ae6d-8c7686edac38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81711ce-dd6c-454e-ae6d-8c7686edac38', 'volume_size': 1} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:19 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 1G" returned: 0 in 1.073s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:19 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 Jun 27 20:01:19 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:19 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4" returned: 0 in 0.788s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727d5095-414c-4baf-a990-e2d40979b71d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc14c443-da2f-4422-bbd4-9e9920160dcd]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:19 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:19 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0" returned: 0 in 0.701s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:19 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:19 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 is being set with open permissions: ugo+rw Jun 27 20:01:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:19 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 Jun 27 20:01:19 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:20 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:20 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0" returned: 0 in 0.655s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d" returned: 0 in 0.771s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:20 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 Jun 27 20:01:20 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.339s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.459s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29162457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:14Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Creating volume dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:01:20 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:01:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:20 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 1073741824 Jun 27 20:01:20 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-159b8372-a773-4d94-b331-f1e6837d9551 tempest-SnapshotsActionsTest-1709040113 None] Create snapshot completed successfully Jun 27 20:01:21 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4" returned: 0 in 0.739s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:21 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4 Jun 27 20:01:21 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-04c61976-0d63-45b3-810d-6d858db30aa0-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-04c61976-0d63-45b3-810d-6d858db30aa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-04c61976-0d63-45b3-810d-6d858db30aa0" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-04c61976-0d63-45b3-810d-6d858db30aa0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Deleting offline snapshot 04c61976-0d63-45b3-810d-6d858db30aa0 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] snapshot_file for this snap is: volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e222697-45f3-4cef-8d21-c84ff58aa918]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:21 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 1073741824" returned: 0 in 0.983s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:21 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 Jun 27 20:01:21 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:21 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:21 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:22 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d.31d2dd77-90f9-490e-836a-c22dfe126ee4" returned: 0 in 0.800s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Lock "cinder-quobyte-31d2dd77-90f9-490e-836a-c22dfe126ee4" released by "_delete_snapshot" :: held 3.207s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Lock "cinder-quobyte-727d5095-414c-4baf-a990-e2d40979b71d" released by "delete_snapshot" :: held 3.234s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:22 devstack cinder-volume[93503]: WARNING cinder.quota [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-823019061 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-823019061, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:22 devstack cinder-volume[93503]: WARNING cinder.quota [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-823019061 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-823019061, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] Created reservations ['8a68681f-dc10-4b08-b2e6-d900a3bed0b3', 'b112c52e-35ce-4c06-b73c-0a991a1e2387', 'e3d754e7-5650-4a70-8cb9-9e9e27a68599', '7efea6d6-a12c-4ac1-8b2a-0588392e39b1'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:22 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 0.674s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=761ee680-df12-4fd9-a969-90ae223d46b5,created_at=2026-06-27T18:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975116909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=761ee680-df12-4fd9-a969-90ae223d46b5,host='devstack@QuobyteHD#QuobyteHD',id=f81711ce-dd6c-454e-ae6d-8c7686edac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151aee1c836497aa146600295039981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:19Z,use_quota=True,user_id='1e858775dcde4dcbb0440806f40dc4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9346788-6e17-4337-a6d9-d75c6513d348),volume_type_id=c9346788-6e17-4337-a6d9-d75c6513d348)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Creating volume f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:01:22 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:22 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 1073741824 Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e3b1f0-7e1f-4bab-9589-5403e77fe88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:22 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfb4bcb-99a4-44a0-a8fd-5edb1b5b241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:22 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0" returned: 0 in 0.843s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:22 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-64a4a81b-d259-4e2e-b43e-511cd8a9a3d6 tempest-GroupSnapshotsV319Test-177938893 None] group_snapshot 9d8ac18d-f6cf-4dca-9e22-be9295394294: deleted successfully Jun 27 20:01:22 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Volume volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 (dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83): created successfully Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfb4bcb-99a4-44a0-a8fd-5edb1b5b241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (b0817298-86b2-4104-9b06-3d196357d095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1637bd05-5b2e-4b71-a385-0dda68606422]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:22 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-452e7a47-0a69-4fb5-86cb-25f9c0855f26 tempest-VolumesSnapshotTestJSON-978396819 None] Created volume successfully. Jun 27 20:01:22 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:22 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:23 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 1073741824" returned: 0 in 0.846s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:23 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.825s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:23 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 Jun 27 20:01:23 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:23 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 Jun 27 20:01:23 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "cinder-quobyte-727d5095-414c-4baf-a990-e2d40979b71d" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Lock "cinder-quobyte-727d5095-414c-4baf-a990-e2d40979b71d" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a98cc5-196f-4652-9b91-93f504a67d16]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:23 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d Jun 27 20:01:23 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:23 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38" returned: 0 in 0.761s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.151s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Creating offline snapshot 520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 of volume dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70297126-2153-4ccd-ac6d-e3a210669885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81711ce-dd6c-454e-ae6d-8c7686edac38', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba5f791-6be6-4fee-bc55-3e14db083da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b92f48-f541-451e-94b5-e50ee9da8c8d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:24 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Volume volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 (f81711ce-dd6c-454e-ae6d-8c7686edac38): created successfully Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba5f791-6be6-4fee-bc55-3e14db083da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Flow 'volume_create_manager' (fc025e72-b83b-4672-9c40-ceda18b0205c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-14df3504-8eac-4867-b759-1550153bf3fa tempest-GroupSnapshotsTest-296585406 None] Created volume successfully. Jun 27 20:01:24 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0" returned: 0 in 0.897s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:24 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:24 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:24 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0 Jun 27 20:01:24 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:24 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d" returned: 0 in 0.875s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:24 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d Jun 27 20:01:24 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:24 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.04c61976-0d63-45b3-810d-6d858db30aa0" returned: 0 in 0.692s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:24 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 0.834s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-04c61976-0d63-45b3-810d-6d858db30aa0" released by "_delete_snapshot" :: held 3.388s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" released by "delete_snapshot" :: held 3.423s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:24 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 1G Jun 27 20:01:24 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:24 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Created reservations ['0134746e-cf08-40ad-b311-0993c65a75c0', '9a60aedf-f8a6-4357-96c8-609cd16ce577', '087e5966-848f-4426-94cd-fd2258c6b4f4', '650d87de-c69a-4f13-9e89-319443db7793'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Delete snapshot completed successfully. Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3979bcd6-4770-4145-b66a-41750a171028 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-04c61976-0d63-45b3-810d-6d858db30aa0-delete_snapshot" released by "delete_snapshot" :: held 3.624s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:25 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] GroupSnapshot dca704c1-0a4c-4e83-8abe-90b7346bd044: creating. Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-727d5095-414c-4baf-a990-e2d40979b71d" returned: 0 in 0.711s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Lock "cinder-quobyte-727d5095-414c-4baf-a990-e2d40979b71d" released by "delete_volume" :: held 1.727s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Group snapshot dca704c1-0a4c-4e83-8abe-90b7346bd044: creating. {{(pid=93503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Created reservations ['1d927499-0103-427a-8175-d740a07b5320'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:25 devstack cinder-volume[93503]: WARNING cinder.quota [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-823019061 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-823019061, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Created reservations ['2d76d92c-a9c4-4b7f-a91f-1b8401e63982', '341d3f3c-a034-4fe6-84cd-ee35b052b78e', '67a8672d-0d05-4490-b78a-323eab62863a', 'd2cf5e9f-908d-4117-a937-85635325845e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:25 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:25 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:25 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 1G" returned: 0 in 0.912s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:25 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 Jun 27 20:01:25 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:26 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.660s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:26 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:26 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8bcf8d9a-e2f9-4e35-8283-596ee3b5a424 tempest-GroupSnapshotsV319Test-177938893 None] Delete group completed successfully. Jun 27 20:01:26 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" returned: 0 in 0.768s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:26 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 is being set with open permissions: ugo+rw Jun 27 20:01:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:26 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 Jun 27 20:01:26 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:27 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" returned: 0 in 0.672s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:27 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info Jun 27 20:01:27 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:27 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info" returned: 0 in 0.666s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:27 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info is being set with open permissions: ugo+rw Jun 27 20:01:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:27 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info Jun 27 20:01:27 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:28 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.info" returned: 0 in 0.689s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.632s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.163s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Creating offline snapshot e96adbce-a081-4918-847f-0b6586056cc3 of volume f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6adc0889-9f1d-40bf-a8f0-bf509119bb73 tempest-VolumesSnapshotTestJSON-978396819 None] Create snapshot completed successfully Jun 27 20:01:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb7657-9904-42fe-b83e-f012503343b9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:28 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 Jun 27 20:01:28 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:29 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38" returned: 0 in 0.849s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:29 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 1G Jun 27 20:01:29 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (f1711567-a3f8-4469-bc81-6eb2f9a37407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b0a1d1-d4f1-449f-b595-dd7e0c571287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b0a1d1-d4f1-449f-b595-dd7e0c571287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-708670937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e390c792-7908-48dc-bb39-fb700c269bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:30Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd860eed-077d-45ce-b15e-46543cbb35a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd860eed-077d-45ce-b15e-46543cbb35a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09067efb-e4f8-4129-9cc5-a17012cacaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09067efb-e4f8-4129-9cc5-a17012cacaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e390c792-7908-48dc-bb39-fb700c269bb3', 'volume_name': 'volume-e390c792-7908-48dc-bb39-fb700c269bb3', 'volume_size': 2, 'snapshot_id': '520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cae4f6-ddec-4960-b9f9-f575644f0d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cae4f6-ddec-4960-b9f9-f575644f0d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6481f33-b601-4636-a999-f0eac8c5ddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:29 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Volume e390c792-7908-48dc-bb39-fb700c269bb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e390c792-7908-48dc-bb39-fb700c269bb3', 'volume_size': 2, 'snapshot_id': '520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8'} Jun 27 20:01:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:30 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 1G" returned: 0 in 0.864s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:30 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 Jun 27 20:01:30 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:31 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3" returned: 0 in 0.697s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:31 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:31 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 Jun 27 20:01:31 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Flow 'volume_create_manager' (4747744d-e96d-43b7-8b94-b01c4ee56f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91fc026-c24d-4ec0-8b71-66d02908fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91fc026-c24d-4ec0-8b71-66d02908fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-908273055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0c2a8f-4857-448f-afa3-0d9f3115aef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97700da4f4c74d94a8184722788bc50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:32Z,use_quota=True,user_id='feda979147bf4a9ca371c62f603e8f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9a339-6848-4d38-a3da-18898319476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:31 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9a339-6848-4d38-a3da-18898319476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be81336-197b-41d9-b24a-6d845115e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be81336-197b-41d9-b24a-6d845115e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0c2a8f-4857-448f-afa3-0d9f3115aef9', 'volume_name': 'volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5835f5b-a720-41ba-a609-9994a6e1f682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5835f5b-a720-41ba-a609-9994a6e1f682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828667b9-3cc1-48c4-a432-8444d7a353b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:31 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Volume 8e0c2a8f-4857-448f-afa3-0d9f3115aef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9', 'volume_size': 1} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3" returned: 0 in 0.696s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:31 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info Jun 27 20:01:31 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:32 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info" returned: 0 in 0.673s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:32 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:01:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:32 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info Jun 27 20:01:32 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:33 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.info" returned: 0 in 0.634s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.072s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Creating offline snapshot 381d06a2-2a3f-4ed6-aad4-bdb38564bd75 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f2896-649f-4f2f-9ea2-9d8626aac048]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d055e5a5-c93e-4df7-824d-59a03692d2f6 tempest-GroupSnapshotsTest-296585406 None] group_snapshot dca704c1-0a4c-4e83-8abe-90b7346bd044: created successfully Jun 27 20:01:33 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:33 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:33 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.761s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:34 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 1G Jun 27 20:01:34 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:34 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] group_snapshot dca704c1-0a4c-4e83-8abe-90b7346bd044: deleting Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] group_snapshot dca704c1-0a4c-4e83-8abe-90b7346bd044: deleting {{(pid=93503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-f81711ce-dd6c-454e-ae6d-8c7686edac38" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-f81711ce-dd6c-454e-ae6d-8c7686edac38" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-e96adbce-a081-4918-847f-0b6586056cc3" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-e96adbce-a081-4918-847f-0b6586056cc3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Deleting offline snapshot e96adbce-a081-4918-847f-0b6586056cc3 of volume f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] snapshot_file for this snap is: volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef831686-a176-4bb1-824a-3d0e150970d5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:34 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 Jun 27 20:01:34 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:34 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 1G" returned: 0 in 0.838s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:34 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 Jun 27 20:01:34 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:34 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3" returned: 0 in 0.798s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f81711ce-dd6c-454e-ae6d-8c7686edac38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b08229-a784-4051-8396-bcc566ad7a55]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:35 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 Jun 27 20:01:35 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:35 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75" returned: 0 in 0.691s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:35 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 is being set with open permissions: ugo+rw Jun 27 20:01:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:35 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 Jun 27 20:01:35 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:35 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38" returned: 0 in 0.776s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:35 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 Jun 27 20:01:35 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:36 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75" returned: 0 in 0.631s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=146,cinder:INSERT=43,cinder:UPDATE=137,cinder:DELETE=7 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=151,cinder:SELECT=148,cinder:DELETE=7,cinder:INSERT=26 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.293s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8-e390c792-7908-48dc-bb39-fb700c269bb3" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8-e390c792-7908-48dc-bb39-fb700c269bb3" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Creating volume e390c792-7908-48dc-bb39-fb700c269bb3 from snapshot 520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-e390c792-7908-48dc-bb39-fb700c269bb3" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-71d016f5-c102-430a-ba3b-eede45869086 tempest-SnapshotsActionsTest-1709040113 None] Create snapshot completed successfully Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e390c792-7908-48dc-bb39-fb700c269bb3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] snapshot: 520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8, volume: e390c792-7908-48dc-bb39-fb700c269bb3, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4ae9b-d3b2-4192-9b9d-a96aac7159e9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:36 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 Jun 27 20:01:36 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:36 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3" returned: 0 in 0.777s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:36 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3 Jun 27 20:01:36 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-381d06a2-2a3f-4ed6-aad4-bdb38564bd75-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-381d06a2-2a3f-4ed6-aad4-bdb38564bd75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-381d06a2-2a3f-4ed6-aad4-bdb38564bd75" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-381d06a2-2a3f-4ed6-aad4-bdb38564bd75" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Deleting offline snapshot 381d06a2-2a3f-4ed6-aad4-bdb38564bd75 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] snapshot_file for this snap is: volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ecdc9-87fe-45af-9ab6-0dbea3ee80fe]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:36 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 Jun 27 20:01:36 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:37 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" returned: 0 in 0.793s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcebc510-748e-4333-ba21-7f5247c3a302]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:37 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38.e96adbce-a081-4918-847f-0b6586056cc3" returned: 0 in 0.655s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-e96adbce-a081-4918-847f-0b6586056cc3" released by "_delete_snapshot" :: held 3.127s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-f81711ce-dd6c-454e-ae6d-8c7686edac38" released by "delete_snapshot" :: held 3.147s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:37 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:37 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:37 devstack cinder-volume[93503]: WARNING cinder.quota [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2131388882 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2131388882, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:37 devstack cinder-volume[93503]: WARNING cinder.quota [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2131388882 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2131388882, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] Created reservations ['c86fda9a-bf4f-48d5-a5ce-a796b60529ef', 'd3c091dd-1b93-4752-82a5-2878cbac645b', '02407c33-db1e-4c85-9bd4-f30baa08f28b', 'f2ce515b-33d7-4c8b-8d28-ac45bc071ea0'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-54744dcd-f4ce-4619-a4dc-73aa9c8b320a tempest-GroupSnapshotsTest-296585406 None] group_snapshot dca704c1-0a4c-4e83-8abe-90b7346bd044: deleted successfully Jun 27 20:01:37 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75" returned: 0 in 0.846s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4934c6-2add-4f47-bd48-680478bf7fac]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:37 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:37 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:37 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 0.803s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:01:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:37 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 Jun 27 20:01:37 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:38 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.784s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:38 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 Jun 27 20:01:38 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "cinder-quobyte-f81711ce-dd6c-454e-ae6d-8c7686edac38" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-f81711ce-dd6c-454e-ae6d-8c7686edac38" acquired by "delete_volume" :: waited 0.043s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a720125d-a27c-40e5-93f4-fc0c178c3805]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:39 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 Jun 27 20:01:39 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:39 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75" returned: 0 in 1.366s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:39 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75 Jun 27 20:01:39 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:40 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38" returned: 0 in 1.516s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:40 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38 Jun 27 20:01:40 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:42 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.381d06a2-2a3f-4ed6-aad4-bdb38564bd75" returned: 0 in 2.411s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-381d06a2-2a3f-4ed6-aad4-bdb38564bd75" released by "_delete_snapshot" :: held 5.583s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" released by "delete_snapshot" :: held 5.620s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Created reservations ['cf0e4669-4789-439c-98b2-63b18d74c63d', '6432612b-adb7-4a72-ae8a-dd587e0c55b1', '13846009-76ab-4400-8ea2-f638c3567ca0', '27702c1b-9c07-4cbc-a90d-71631c97f7ad'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Delete snapshot completed successfully. Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e60e7202-b7b1-45d2-9058-d7947960a389 tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-381d06a2-2a3f-4ed6-aad4-bdb38564bd75-delete_snapshot" released by "delete_snapshot" :: held 6.016s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f81711ce-dd6c-454e-ae6d-8c7686edac38" returned: 0 in 2.236s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:42 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Lock "cinder-quobyte-f81711ce-dd6c-454e-ae6d-8c7686edac38" released by "delete_volume" :: held 3.897s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['86d0282e-8560-4b1f-a439-034a027712d9'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:42 devstack cinder-volume[93503]: WARNING cinder.quota [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2131388882 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2131388882, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:01:42 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Created reservations ['ed2bed7c-d5a2-4eb4-948a-688a0b93d4ac', '0f58c48e-9a9b-4e00-8ee2-4d7e67df6f62', '6f1b2ed5-5e79-4afb-84c7-11220f7392ba', '6d20defc-259a-4619-939a-e0c16eb6f87a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:43 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:43 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:43 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3" returned: 0 in 5.748s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e298b-4196-49d4-801e-91e620bbefae]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:43 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:43 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:44 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.979s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:44 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3f08a420-8e34-4527-bb88-5582ba6525c5 tempest-GroupSnapshotsTest-296585406 None] Delete group completed successfully. Jun 27 20:01:44 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 0.998s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:44 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:01:44 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Converted 1024.00 MB image at 178.11 MB/s Jun 27 20:01:44 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 is being set with open permissions: ugo+rw Jun 27 20:01:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:44 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 Jun 27 20:01:44 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:45 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3" returned: 0 in 0.672s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e390c792-7908-48dc-bb39-fb700c269bb3" released by "_copy_volume_from_snapshot" :: held 9.129s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8-e390c792-7908-48dc-bb39-fb700c269bb3" released by "_create_volume_from_snapshot" :: held 9.167s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.196s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.602s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-908273055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0c2a8f-4857-448f-afa3-0d9f3115aef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97700da4f4c74d94a8184722788bc50d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:32Z,use_quota=True,user_id='feda979147bf4a9ca371c62f603e8f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Creating volume 8e0c2a8f-4857-448f-afa3-0d9f3115aef9 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:01:45 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:45 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 1073741824 Jun 27 20:01:45 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6481f33-b601-4636-a999-f0eac8c5ddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e390c792-7908-48dc-bb39-fb700c269bb3', 'volume_size': 2, 'snapshot_id': '520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cb7125-2a05-4f22-9128-2f31a4bfdcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Volume volume-e390c792-7908-48dc-bb39-fb700c269bb3 (e390c792-7908-48dc-bb39-fb700c269bb3): created successfully Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cb7125-2a05-4f22-9128-2f31a4bfdcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (f1711567-a3f8-4469-bc81-6eb2f9a37407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-09872fa4-198c-4b56-b5f5-9a33a380cf65 tempest-VolumesSnapshotTestJSON-978396819 None] Created volume successfully. Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-e390c792-7908-48dc-bb39-fb700c269bb3-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:46 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 1073741824" returned: 0 in 0.931s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-e390c792-7908-48dc-bb39-fb700c269bb3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-e390c792-7908-48dc-bb39-fb700c269bb3" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:46 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 Jun 27 20:01:46 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e390c792-7908-48dc-bb39-fb700c269bb3" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e480e-3302-41ed-ab99-f6cfd50615e5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:46 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 Jun 27 20:01:46 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:47 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9" returned: 0 in 0.670s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.245s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828667b9-3cc1-48c4-a432-8444d7a353b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a343e-b9d8-420c-b968-d90981438fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Creating offline snapshot 27abf222-e9de-4bb9-9303-6aea67571af2 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:47 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Volume volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 (8e0c2a8f-4857-448f-afa3-0d9f3115aef9): created successfully Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a343e-b9d8-420c-b968-d90981438fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Flow 'volume_create_manager' (4747744d-e96d-43b7-8b94-b01c4ee56f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd3ccf5-9f3f-445b-a4dc-7da9d7c076c0]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-274b65ea-5655-43b1-b2c5-c098846f46b5 tempest-VolumesServicesTestJSON-1360432163 None] Created volume successfully. Jun 27 20:01:47 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:47 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:47 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3" returned: 0 in 0.858s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:47 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3 Jun 27 20:01:47 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:47 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.833s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:48 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 1G Jun 27 20:01:48 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:48 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e390c792-7908-48dc-bb39-fb700c269bb3" returned: 0 in 0.721s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e390c792-7908-48dc-bb39-fb700c269bb3" released by "delete_volume" :: held 1.632s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['c8d9bf6c-61f9-4a82-9437-9a6496d8e451', '6e8f1fbd-0f6b-4f42-a88b-29ebe3396a8d', 'dfae2f17-abbd-42cf-93b1-aac64a1bd9fe', 'ef4b31d0-c7cf-41f0-88af-7d53e4dd7a1d'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:48 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:48 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Acquiring lock "cinder-8e0c2a8f-4857-448f-afa3-0d9f3115aef9-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Lock "cinder-8e0c2a8f-4857-448f-afa3-0d9f3115aef9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Acquiring lock "cinder-quobyte-8e0c2a8f-4857-448f-afa3-0d9f3115aef9" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Lock "cinder-quobyte-8e0c2a8f-4857-448f-afa3-0d9f3115aef9" acquired by "delete_volume" :: waited 0.031s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc68efa-d8f1-40cb-976b-4db216297f09]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Deleting offline snapshot 520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 of volume dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] snapshot_file for this snap is: volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ebee57-9509-4fd7-8100-7a169afa78b6]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:48 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 Jun 27 20:01:48 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:48 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 Jun 27 20:01:48 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:49 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.852s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Deleted volume successfully. Jun 27 20:01:49 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b29f3efb-3173-4d41-921c-2197748f9933 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-e390c792-7908-48dc-bb39-fb700c269bb3-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 1G" returned: 0 in 1.199s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:49 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 Jun 27 20:01:49 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:49 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" returned: 0 in 0.910s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e0bfb-4392-47b5-af19-080f06820f82]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:49 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9" returned: 0 in 1.161s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:49 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9 Jun 27 20:01:49 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:49 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:49 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:49 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2" returned: 0 in 0.779s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:49 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 is being set with open permissions: ugo+rw Jun 27 20:01:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:50 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 Jun 27 20:01:50 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:50 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8e0c2a8f-4857-448f-afa3-0d9f3115aef9" returned: 0 in 0.790s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Lock "cinder-quobyte-8e0c2a8f-4857-448f-afa3-0d9f3115aef9" released by "delete_volume" :: held 2.038s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Created reservations ['1afdc6e9-225f-4b87-8022-f6a5dd6887a3', '8aba20eb-5877-46e7-90b6-fdf10096709a', 'a9ea1a70-3591-4bc4-9208-0c8d16658459', 'eb492964-8fc0-4260-8934-55f06050946a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:50 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 1.066s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:50 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2" returned: 0 in 0.848s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:50 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:50 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:50 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 Jun 27 20:01:50 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.804s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ed26558d-79f6-49de-afb2-035de3954872 tempest-SnapshotsActionsTest-1709040113 None] Create snapshot completed successfully Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-27abf222-e9de-4bb9-9303-6aea67571af2-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-27abf222-e9de-4bb9-9303-6aea67571af2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-27abf222-e9de-4bb9-9303-6aea67571af2" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-27abf222-e9de-4bb9-9303-6aea67571af2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Deleting offline snapshot 27abf222-e9de-4bb9-9303-6aea67571af2 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] snapshot_file for this snap is: volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9184cc3-87e6-4523-b0be-d8358ccd39f3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:51 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.804s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Deleted volume successfully. Jun 27 20:01:51 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b9c38ab-0f16-44ec-908c-155deec07ca7 tempest-VolumesServicesTestJSON-1360432163 None] Lock "cinder-8e0c2a8f-4857-448f-afa3-0d9f3115aef9-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:51 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:51 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" returned: 0 in 0.962s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:51 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8 Jun 27 20:01:51 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:52 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2" returned: 0 in 0.922s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de1232-74c4-4764-8d66-6d19074bef03]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:52 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83.520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" returned: 0 in 0.786s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:52 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8" released by "_delete_snapshot" :: held 3.869s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:52 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" released by "delete_snapshot" :: held 3.897s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['484bae90-4347-4b7b-81b3-265985f3bed4', '3929b07f-e6e5-4660-ba09-ef947f373fc9', '6310f1e2-711d-4644-92c4-83eb0b2dbb7f', '00fd2932-6611-4875-9b4e-1d75526b580e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Delete snapshot completed successfully. Jun 27 20:01:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e32e911e-ce7c-4de6-82f0-1498df9469ac tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-520a4e98-2c3f-4d59-a3bc-dfab2cf2f2b8-delete_snapshot" released by "delete_snapshot" :: held 4.091s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eeab2d-b7d3-4d59-ba50-b3eb93b0a178]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:53 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:53 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:53 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.977s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:53 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 Jun 27 20:01:53 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:54 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 1.047s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:54 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83 Jun 27 20:01:54 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:54 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2" returned: 0 in 1.016s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:54 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2 Jun 27 20:01:54 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:55 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83" released by "delete_volume" :: held 1.923s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['d0bcc652-ed4d-419c-9fdb-78058e14a583', '8343c002-eda6-4e8b-a351-b3195076af36', '713b74f7-51bf-452d-b8cf-d4665a5f3c57', '9e09f772-f9c3-4ff7-aaaa-345c42f6bd7e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:55 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.27abf222-e9de-4bb9-9303-6aea67571af2" returned: 0 in 0.842s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:55 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:01:55 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-29a2afaf-eaa8-4338-9ff2-85276065b81a tempest-GroupsV314Test-602849523 None] Group tempest-GroupsV314Test-Group-844850874: creating Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-27abf222-e9de-4bb9-9303-6aea67571af2" released by "_delete_snapshot" :: held 3.906s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" released by "delete_snapshot" :: held 3.947s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-29a2afaf-eaa8-4338-9ff2-85276065b81a tempest-GroupsV314Test-602849523 None] Group tempest-GroupsV314Test-Group-844850874: created successfully Jun 27 20:01:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-29a2afaf-eaa8-4338-9ff2-85276065b81a tempest-GroupsV314Test-602849523 None] Create group completed successfully. Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Created reservations ['27a51942-c83c-4be0-ac1d-3148443e5ed4', '1dc9582e-0682-4b29-bc9d-f0578e50c2df', '33ead4b3-27b7-4011-ae10-2ee6e6d0efee', 'ee43c4ea-5955-4f29-8f19-9fa36d145a03'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:01:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Delete snapshot completed successfully. Jun 27 20:01:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-038ad323-84fc-4373-9fdc-df56a8dd38fc tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-27abf222-e9de-4bb9-9303-6aea67571af2-delete_snapshot" released by "delete_snapshot" :: held 4.198s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:56 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.844s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:01:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Deleted volume successfully. Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f12cd45e-ca71-4d90-b1af-2c8e9a5c2b9d tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-dc5031bc-6f4d-47f7-bcbb-a4e1a8a6da83-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (26d1bc19-ddb0-461e-a90a-b5ec2bad6496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21bfee1-5b56-47a0-932d-4f9a0a0148d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21bfee1-5b56-47a0-932d-4f9a0a0148d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-650331605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc7d299-244b-46c0-871a-a7d65ed5bdea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:56Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271d801e-f8a4-4da0-95ba-5f8ff226e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271d801e-f8a4-4da0-95ba-5f8ff226e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcf359b-684d-4283-98b8-c1280435692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcf359b-684d-4283-98b8-c1280435692a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc7d299-244b-46c0-871a-a7d65ed5bdea', 'volume_name': 'volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390d7019-bf73-4c68-8db1-6224e0284ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390d7019-bf73-4c68-8db1-6224e0284ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2aa7ea0-8fc7-45f5-b677-bea76747854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:56 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Volume 4cc7d299-244b-46c0-871a-a7d65ed5bdea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea', 'volume_size': 1} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Creating offline snapshot d06e8e3f-8477-47b8-9c17-e5eaa021b633 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12c625-abd8-4fd6-9d23-6fbef7774c89]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:01:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:56 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:01:56 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Flow 'volume_create_manager' (aae9df16-d521-4ae7-88f9-b29af424c314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cd118f-d255-4653-a5ea-bc086beef513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cd118f-d255-4653-a5ea-bc086beef513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354554154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b232914-0648-4042-b08b-429acd70ecdf,host='devstack@QuobyteHD#QuobyteHD',id=afc34a0d-4139-4167-a83f-0ccdaef66544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9825ae419e894f55a2d5714a00e994d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:57Z,use_quota=True,user_id='232ed681fd4642afbcd908b86690badb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5244fd41-4a91-4f14-8f21-191250e796a5),volume_type_id=5244fd41-4a91-4f14-8f21-191250e796a5)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8ad16e-193d-4afa-8c31-253a674e640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8ad16e-193d-4afa-8c31-253a674e640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24633982-6fff-47a3-aba1-8dda3a0dfe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24633982-6fff-47a3-aba1-8dda3a0dfe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc34a0d-4139-4167-a83f-0ccdaef66544', 'volume_name': 'volume-afc34a0d-4139-4167-a83f-0ccdaef66544', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fa1317-f8a1-4d37-94bd-82cc0fb9a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fa1317-f8a1-4d37-94bd-82cc0fb9a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ef004b-f512-4ba0-ae65-04498318a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:01:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Volume afc34a0d-4139-4167-a83f-0ccdaef66544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc34a0d-4139-4167-a83f-0ccdaef66544', 'volume_size': 1} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:57 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.837s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:01:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:57 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 1G Jun 27 20:01:57 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:58 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 1G" returned: 0 in 0.842s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:58 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 Jun 27 20:01:58 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:58 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633" returned: 0 in 0.737s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:58 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 is being set with open permissions: ugo+rw Jun 27 20:01:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:58 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 Jun 27 20:01:58 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:59 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633" returned: 0 in 0.723s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.300s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.255s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-650331605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc7d299-244b-46c0-871a-a7d65ed5bdea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:56Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Creating volume 4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:01:59 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:01:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:01:59 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea 1073741824 Jun 27 20:01:59 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:01:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c59167b3-143a-41de-86e8-bc42d624c3fb tempest-SnapshotsActionsTest-1709040113 None] Create snapshot completed successfully Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-d06e8e3f-8477-47b8-9c17-e5eaa021b633-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-d06e8e3f-8477-47b8-9c17-e5eaa021b633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Acquiring lock "cinder-quobyte-d06e8e3f-8477-47b8-9c17-e5eaa021b633" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-d06e8e3f-8477-47b8-9c17-e5eaa021b633" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Deleting offline snapshot d06e8e3f-8477-47b8-9c17-e5eaa021b633 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] snapshot_file for this snap is: volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[74661dd3-a30f-408e-92fd-10615f88f646]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:00 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea 1073741824" returned: 0 in 1.006s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:00 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:00 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:00 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 Jun 27 20:02:00 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:01 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 0.724s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.243s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b232914-0648-4042-b08b-429acd70ecdf,created_at=2026-06-27T18:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354554154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b232914-0648-4042-b08b-429acd70ecdf,host='devstack@QuobyteHD#QuobyteHD',id=afc34a0d-4139-4167-a83f-0ccdaef66544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9825ae419e894f55a2d5714a00e994d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:01:57Z,use_quota=True,user_id='232ed681fd4642afbcd908b86690badb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5244fd41-4a91-4f14-8f21-191250e796a5),volume_type_id=5244fd41-4a91-4f14-8f21-191250e796a5)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Creating volume afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:02:01 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2aa7ea0-8fc7-45f5-b677-bea76747854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968f36b1-501c-4c97-af69-0d1d50b10b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:01 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 1073741824 Jun 27 20:02:01 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Volume volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea (4cc7d299-244b-46c0-871a-a7d65ed5bdea): created successfully Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968f36b1-501c-4c97-af69-0d1d50b10b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:01 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (26d1bc19-ddb0-461e-a90a-b5ec2bad6496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633" returned: 0 in 0.907s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:01 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-134e7632-e0cf-4346-a983-a4522219f815 tempest-VolumesSnapshotTestJSON-978396819 None] Created volume successfully. Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d84e11-489c-4189-87e4-b01cc44168db]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:01 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:02:01 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:02 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.999s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:02 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 1073741824" returned: 0 in 1.166s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:02 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 Jun 27 20:02:02 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:02 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:02 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:03 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 0.731s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.505s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ef004b-f512-4ba0-ae65-04498318a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc34a0d-4139-4167-a83f-0ccdaef66544', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedf9aa1-f654-4564-bf02-e545fb165a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Creating offline snapshot cc75ae1a-1494-495c-bfdb-b22a007c637e of volume 4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:02:03 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Volume volume-afc34a0d-4139-4167-a83f-0ccdaef66544 (afc34a0d-4139-4167-a83f-0ccdaef66544): created successfully Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedf9aa1-f654-4564-bf02-e545fb165a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Flow 'volume_create_manager' (aae9df16-d521-4ae7-88f9-b29af424c314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f2aa1-85dc-492e-8c1b-070d9f7d2e4c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d0e05d00-879a-4aac-9ce4-d965e77d5b18 tempest-GroupsV314Test-602849523 None] Created volume successfully. Jun 27 20:02:03 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633" returned: 0 in 0.947s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:03 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633 Jun 27 20:02:03 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:03 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:03 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:04 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.d06e8e3f-8477-47b8-9c17-e5eaa021b633" returned: 0 in 0.712s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-d06e8e3f-8477-47b8-9c17-e5eaa021b633" released by "_delete_snapshot" :: held 3.706s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" released by "delete_snapshot" :: held 3.732s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Created reservations ['10d9ecc4-30d5-40d7-a40f-2a73612aac31', '6f7fdb3c-8e1f-4d74-b904-8d9ba453d269', '6cee8768-7d6d-4dc4-80f9-b0e89ca763d0', 'fcdb6d24-14aa-4ef6-be8a-79f2383de0a9'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:04 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 0.951s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Delete snapshot completed successfully. Jun 27 20:02:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfbc529b-72ae-4bbc-aa51-cae92bbfa5fb tempest-SnapshotsActionsTest-538814782 None] Lock "cinder-d06e8e3f-8477-47b8-9c17-e5eaa021b633-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:04 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e 1G Jun 27 20:02:04 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "cinder-6ab1d8b9-5d38-4c59-a43c-430332f0f186-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-6ab1d8b9-5d38-4c59-a43c-430332f0f186-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "cinder-quobyte-6ab1d8b9-5d38-4c59-a43c-430332f0f186" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-quobyte-6ab1d8b9-5d38-4c59-a43c-430332f0f186" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Deleting offline snapshot 6ab1d8b9-5d38-4c59-a43c-430332f0f186 of volume cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] snapshot_file for this snap is: volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2526f6-253c-4313-b859-bc3884980655]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:05 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e 1G" returned: 0 in 1.027s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:05 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e Jun 27 20:02:05 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:05 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:02:05 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:06 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e" returned: 0 in 0.806s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:06 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e is being set with open permissions: ugo+rw Jun 27 20:02:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:06 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.888s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:06 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e Jun 27 20:02:06 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:06 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47a7bd-107d-4097-bc8f-d8e4cbd02c41]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:06 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 Jun 27 20:02:06 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:07 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e" returned: 0 in 0.800s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:07 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info Jun 27 20:02:07 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:07 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6" returned: 0 in 0.963s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:07 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:02:07 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:07 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:07 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info is being set with open permissions: ugo+rw Jun 27 20:02:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:07 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info Jun 27 20:02:07 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:08 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 1.131s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:08 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186 Jun 27 20:02:08 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:08 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.info" returned: 0 in 0.888s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.455s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.198s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:08 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Cloning volume afc34a0d-4139-4167-a83f-0ccdaef66544 to volume f4392552-1686-44c1-9d12-cc82035c057f Jun 27 20:02:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-79e422af-dca5-437e-9579-5e514255b724 tempest-VolumesSnapshotTestJSON-978396819 None] Create snapshot completed successfully Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Creating offline snapshot 91dc33ce-c04d-411b-bcb9-53d1f9f28653 of volume afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd11aead-fdcd-4392-b7fb-c78bcf820222]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:09 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:09 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:09 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6.6ab1d8b9-5d38-4c59-a43c-430332f0f186" returned: 0 in 0.793s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-quobyte-6ab1d8b9-5d38-4c59-a43c-430332f0f186" released by "_delete_snapshot" :: held 4.026s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" released by "delete_snapshot" :: held 4.066s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Created reservations ['ab6c22e0-21c9-408a-a408-3605c2be790c', '8f69d344-bc6f-4364-8c3d-52af3ba04251', 'c0d2942f-4047-47d0-b449-45a2d30dc49c', '24f461e0-8b41-4c39-9909-d09eeeb777db'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Delete snapshot completed successfully. Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ebfc1755-191a-4edb-9f5a-d2c7f1255033 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-6ab1d8b9-5d38-4c59-a43c-430332f0f186-delete_snapshot" released by "delete_snapshot" :: held 4.342s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "cinder-cefe884b-bace-4070-b0c7-57af7d6c1dd6-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-cefe884b-bace-4070-b0c7-57af7d6c1dd6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:10 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 1.162s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d448dd5a-daff-41df-89f2-891838a4271c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:10 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 1G Jun 27 20:02:10 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:10 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 Jun 27 20:02:10 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (e0173802-80e9-453f-bd12-dc39967d5af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b315ea3-cd14-4819-8506-0a9fdf4ce556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b315ea3-cd14-4819-8506-0a9fdf4ce556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-701037264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ed2e23ba349018e110d6065510e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc75ae1a-1494-495c-bfdb-b22a007c637e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:10Z,use_quota=True,user_id='bf246b192b534b08a44a9b9532569cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b610d3e-1236-448b-9171-0f7ac0fbad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b610d3e-1236-448b-9171-0f7ac0fbad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5720f39a-6cb4-4d0a-94d6-08bedb4b740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5720f39a-6cb4-4d0a-94d6-08bedb4b740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108', 'volume_name': 'volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108', 'volume_size': 1, 'snapshot_id': 'cc75ae1a-1494-495c-bfdb-b22a007c637e'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46811fb-693e-4c01-95fd-e3740675b475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46811fb-693e-4c01-95fd-e3740675b475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc8c46f-3d33-491f-9262-d0e897a40325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:10 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Volume 2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108', 'volume_size': 1, 'snapshot_id': 'cc75ae1a-1494-495c-bfdb-b22a007c637e'} Jun 27 20:02:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:11 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 1G" returned: 0 in 1.080s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc34a0d-4139-4167-a83f-0ccdaef66544 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:11 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc34a0d-4139-4167-a83f-0ccdaef66544 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 Jun 27 20:02:11 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:11 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6" returned: 0 in 1.144s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:11 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6 Jun 27 20:02:11 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:11 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc34a0d-4139-4167-a83f-0ccdaef66544 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653" returned: 0 in 0.726s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:11 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:11 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:11 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cefe884b-bace-4070-b0c7-57af7d6c1dd6" returned: 0 in 0.674s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:11 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-quobyte-cefe884b-bace-4070-b0c7-57af7d6c1dd6" released by "delete_volume" :: held 1.936s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Created reservations ['bb72c5a8-b768-4452-a9dc-b9c7080733d1', '41c5e4b6-a5a7-4d9c-817b-81e7885c6101', '8d05ff7e-3921-41fe-83e0-c64e06ffaf0f', 'b13cf481-2b67-43d5-aa2a-c117d9c95ac5'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:12 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:12 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:12 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653" returned: 0 in 0.991s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:12 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info Jun 27 20:02:12 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:12 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.857s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:12 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Deleted volume successfully. Jun 27 20:02:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bbb61080-8a35-4db3-8492-5a45eedd2959 tempest-SnapshotsActionsTest-1709040113 None] Lock "cinder-cefe884b-bace-4070-b0c7-57af7d6c1dd6-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:13 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info" returned: 0 in 0.827s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:13 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:02:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:13 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info Jun 27 20:02:13 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.info" returned: 0 in 0.759s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:14 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Acquiring lock "cinder-quobyte-f4392552-1686-44c1-9d12-cc82035c057f" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-f4392552-1686-44c1-9d12-cc82035c057f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] snapshot: 91dc33ce-c04d-411b-bcb9-53d1f9f28653, volume: f4392552-1686-44c1-9d12-cc82035c057f, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce2813-ec6c-450c-968f-4229026da9f3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:14 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 Jun 27 20:02:14 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:15 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653" returned: 0 in 0.843s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc34a0d-4139-4167-a83f-0ccdaef66544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:02:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:02:15 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26e26d9-5ee6-4dcd-b943-d8800e89a226]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:15 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:15 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:16 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:16 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:16 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 1.007s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:02:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:16 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f Jun 27 20:02:16 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:17 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.900s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:02:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:02:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:02:22 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=81,cinder:UPDATE=92,cinder:DELETE=5,cinder:INSERT=28 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:02:22 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f" returned: 0 in 6.477s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:22 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=94,cinder:SELECT=83,cinder:INSERT=23,cinder:DELETE=7 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:02:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3829e877-627a-4c06-bb42-6457a55040da]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:23 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:23 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:24 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 1.149s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:24 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:02:24 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Converted 1024.00 MB image at 158.08 MB/s Jun 27 20:02:24 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f is being set with open permissions: ugo+rw: NotImplementedError Jun 27 20:02:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:24 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f Jun 27 20:02:24 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:25 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f" returned: 0 in 0.971s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-f4392552-1686-44c1-9d12-cc82035c057f" released by "_copy_volume_from_snapshot" :: held 10.607s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Acquiring lock "cinder-quobyte-91dc33ce-c04d-411b-bcb9-53d1f9f28653" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-91dc33ce-c04d-411b-bcb9-53d1f9f28653" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Deleting offline snapshot 91dc33ce-c04d-411b-bcb9-53d1f9f28653 of volume afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] snapshot_file for this snap is: volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bacd1c-0257-4e15-894b-5fb595d5a635]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:25 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 Jun 27 20:02:25 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:26 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653" returned: 0 in 0.912s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc34a0d-4139-4167-a83f-0ccdaef66544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac0dfd6-d6de-49b1-ab50-45377d2845a2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:26 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:26 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:27 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 1.010s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:27 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 Jun 27 20:02:27 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:28 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653" returned: 0 in 0.826s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:28 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653 Jun 27 20:02:28 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:28 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544.91dc33ce-c04d-411b-bcb9-53d1f9f28653" returned: 0 in 0.694s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-91dc33ce-c04d-411b-bcb9-53d1f9f28653" released by "_delete_snapshot" :: held 3.559s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.962s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.388s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-cc75ae1a-1494-495c-bfdb-b22a007c637e-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-cc75ae1a-1494-495c-bfdb-b22a007c637e-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Creating volume 2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 from snapshot cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] snapshot: cc75ae1a-1494-495c-bfdb-b22a007c637e, volume: 2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b766f-aa04-43c6-908d-e31aa3bffd53]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:29 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-31fb51fd-ab9e-468c-a0c9-f88b45216a86 tempest-GroupsV314Test-602849523 None] Create group from source-group-6b232914-0648-4042-b08b-429acd70ecdf completed successfully. Jun 27 20:02:29 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e Jun 27 20:02:29 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Acquiring lock "cinder-quobyte-f4392552-1686-44c1-9d12-cc82035c057f" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Flow 'volume_create_manager' (4a0ad3c2-f407-4f67-a8b5-121a11c43bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e8ad65-9fc4-4ec4-ade3-062ab1134ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-f4392552-1686-44c1-9d12-cc82035c057f" acquired by "delete_volume" :: waited 0.054s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e8ad65-9fc4-4ec4-ade3-062ab1134ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1557195662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232bebc7-eeac-4858-bc64-4569c7e2a381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354789c07824281a0658c28e7e46284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:30Z,use_quota=True,user_id='2c979abaab6f4bc3a0947845d96eb718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9249bec-a10c-46d6-a20d-9b9918d57d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9249bec-a10c-46d6-a20d-9b9918d57d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5a073f-00fb-4e76-b6c8-cc116064b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5a073f-00fb-4e76-b6c8-cc116064b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232bebc7-eeac-4858-bc64-4569c7e2a381', 'volume_name': 'volume-232bebc7-eeac-4858-bc64-4569c7e2a381', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c046f7-e47e-499d-b548-f785db39aafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c046f7-e47e-499d-b548-f785db39aafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc416608-9b25-498c-84a5-925638496377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:29 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Volume 232bebc7-eeac-4858-bc64-4569c7e2a381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232bebc7-eeac-4858-bc64-4569c7e2a381', 'volume_size': 1} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76650232-bc90-4d30-bfc3-9b5c65d228da]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:29 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e" returned: 0 in 0.944s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e8a2e9-f9da-4aae-af1c-a00d1844651e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:29 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f Jun 27 20:02:29 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:30 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:30 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:30 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f" returned: 0 in 0.819s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:30 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f Jun 27 20:02:30 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:30 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 0.803s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:30 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:02:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:30 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 Jun 27 20:02:30 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:31 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f4392552-1686-44c1-9d12-cc82035c057f" returned: 0 in 0.684s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-f4392552-1686-44c1-9d12-cc82035c057f" released by "delete_volume" :: held 1.577s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Created reservations ['46c401ae-ffa4-4293-8637-af443a8c91ed'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:31 devstack cinder-volume[93503]: WARNING cinder.quota [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1874103328 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1874103328, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:02:31 devstack cinder-volume[93503]: WARNING cinder.quota [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1874103328 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1874103328, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Created reservations ['12bf6e16-2b1e-420b-a759-274480d10e08', '63b42bbc-83ec-4bd7-81b6-57ac2f251d72', 'a75cf279-8db1-4cea-b647-a51cd5ae54f0', '766695a6-067b-41a4-8e08-3cea7718bdb2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:31 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:31 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Acquiring lock "cinder-quobyte-afc34a0d-4139-4167-a83f-0ccdaef66544" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-afc34a0d-4139-4167-a83f-0ccdaef66544" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53cc9c1-e49c-41b4-a43b-ac276cd15424]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:33 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.890s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:33 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7a8e0de6-bb57-4318-84c2-030862e99447 tempest-GroupsV314Test-602849523 None] Delete group completed successfully. Jun 27 20:02:33 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:33 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:35 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 1.874s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:35 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544 Jun 27 20:02:35 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:36 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afc34a0d-4139-4167-a83f-0ccdaef66544" returned: 0 in 1.086s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Lock "cinder-quobyte-afc34a0d-4139-4167-a83f-0ccdaef66544" released by "delete_volume" :: held 3.134s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Created reservations ['1c2dfeb4-0233-480b-bdd9-6654913e6891'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Created reservations ['919f3689-db29-472e-9bd6-a0c66987d58b', '34513fcd-971a-4419-b229-ea33ca2e2d4c', 'f8bf79a6-5366-487c-9154-53b22bfb3e75', '345aec17-9203-47d3-92ce-3535f7a9844d'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:36 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" returned: 0 in 6.064s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043a245-3e75-4ddf-9a9e-a785bae92ab8]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:36 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:36 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:36 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:36 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:37 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.906s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-71590198-2d10-4505-9031-7a2df9bfac55 tempest-GroupsV314Test-602849523 None] Delete group completed successfully. Jun 27 20:02:38 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 1.227s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:02:38 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Converted 1024.00 MB image at 168.84 MB/s Jun 27 20:02:38 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 is being set with open permissions: ugo+rw Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:38 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 Jun 27 20:02:38 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:38 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" released by "_copy_volume_from_snapshot" :: held 9.901s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-cc75ae1a-1494-495c-bfdb-b22a007c637e-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" released by "_create_volume_from_snapshot" :: held 9.947s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.972s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.946s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1557195662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232bebc7-eeac-4858-bc64-4569c7e2a381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354789c07824281a0658c28e7e46284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:30Z,use_quota=True,user_id='2c979abaab6f4bc3a0947845d96eb718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Creating volume 232bebc7-eeac-4858-bc64-4569c7e2a381 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:02:38 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:38 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 1073741824 Jun 27 20:02:38 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc8c46f-3d33-491f-9262-d0e897a40325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108', 'volume_size': 1, 'snapshot_id': 'cc75ae1a-1494-495c-bfdb-b22a007c637e'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ec7636-63cf-41ec-a889-cf947634322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Volume volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 (2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108): created successfully Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ec7636-63cf-41ec-a889-cf947634322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Flow 'volume_create_manager' (e0173802-80e9-453f-bd12-dc39967d5af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-67af4c63-3a9e-4160-b1b5-297545065535 tempest-VolumesSnapshotTestJSON-978396819 None] Created volume successfully. Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[557659f5-e077-49a4-acd5-da6c89d447bf]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:39 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 1073741824" returned: 0 in 1.013s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:39 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 Jun 27 20:02:39 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:39 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 Jun 27 20:02:39 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:40 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" returned: 0 in 0.947s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:40 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108 Jun 27 20:02:40 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:40 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381" returned: 0 in 0.857s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc416608-9b25-498c-84a5-925638496377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232bebc7-eeac-4858-bc64-4569c7e2a381', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c2f79-e0f7-4643-bb98-60bb5a124265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:40 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Volume volume-232bebc7-eeac-4858-bc64-4569c7e2a381 (232bebc7-eeac-4858-bc64-4569c7e2a381): created successfully Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c2f79-e0f7-4643-bb98-60bb5a124265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Flow 'volume_create_manager' (4a0ad3c2-f407-4f67-a8b5-121a11c43bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-847ad1d2-dbda-4bcb-af44-5738653f29cf tempest-VolumeQuotasAdminTestJSON-837411502 None] Created volume successfully. Jun 27 20:02:41 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" returned: 0 in 0.747s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108" released by "delete_volume" :: held 1.743s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['a3aa227a-c59a-4c96-8e35-3bae298b4f12', '720043b9-2d30-43a5-a783-ca21e384942e', 'f2220a28-2855-49ec-a7a9-a235a2260459', 'c657ece5-d0b2-4526-a3e6-3c89e5a30441'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:41 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:41 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-cc75ae1a-1494-495c-bfdb-b22a007c637e-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-cc75ae1a-1494-495c-bfdb-b22a007c637e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-4cc7d299-244b-46c0-871a-a7d65ed5bdea" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-4cc7d299-244b-46c0-871a-a7d65ed5bdea" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-cc75ae1a-1494-495c-bfdb-b22a007c637e" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-cc75ae1a-1494-495c-bfdb-b22a007c637e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Deleting offline snapshot cc75ae1a-1494-495c-bfdb-b22a007c637e of volume 4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] snapshot_file for this snap is: volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e8fe4-5ccb-4e50-b8db-4602db541182]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "cinder-232bebc7-eeac-4858-bc64-4569c7e2a381-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "cinder-232bebc7-eeac-4858-bc64-4569c7e2a381-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "cinder-quobyte-232bebc7-eeac-4858-bc64-4569c7e2a381" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:42 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e Jun 27 20:02:42 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "cinder-quobyte-232bebc7-eeac-4858-bc64-4569c7e2a381" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[18062a54-e798-42ef-bebe-3f45c6abc580]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:42 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.773s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Deleted volume successfully. Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c73bbe1-4a68-4bdd-af5b-ab0d8290cae6 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-2fb2fb7d-2ef8-4ee6-967f-c61ef9bea108-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:42 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 Jun 27 20:02:42 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:42 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e" returned: 0 in 0.983s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab28ae8-04c1-404f-85e3-db5e3cfdfeee]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:43 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:43 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:43 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381" returned: 0 in 0.923s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:43 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381 Jun 27 20:02:43 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:43 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-232bebc7-eeac-4858-bc64-4569c7e2a381" returned: 0 in 0.702s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:43 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 0.877s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:43 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "cinder-quobyte-232bebc7-eeac-4858-bc64-4569c7e2a381" released by "delete_volume" :: held 1.726s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:43 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e Jun 27 20:02:43 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Created reservations ['f60a4fe3-9deb-45a8-ac90-a85f23e596a7', '7a4e4ddf-046e-44ba-8a8e-a6f64365cc80', 'd290e6fe-08ad-4a87-8161-0d0706ae0ce2', 'dd0cc3ff-da31-4caa-bff4-742917510630'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:44 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:44 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:45 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Flow 'volume_create_manager' (8e66cb28-147a-4501-ab31-1e06e0a67569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83365c1d-71eb-489c-80ef-35561bfd6f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.309s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:45 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e" returned: 0 in 1.560s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Deleted volume successfully. Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83365c1d-71eb-489c-80ef-35561bfd6f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-867974595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae42cc1-ff6b-41ae-8523-da5a5b2516ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354789c07824281a0658c28e7e46284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:45Z,use_quota=True,user_id='2c979abaab6f4bc3a0947845d96eb718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a6ab09-539b-47c3-9db6-c1a3ef3c0239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a6ab09-539b-47c3-9db6-c1a3ef3c0239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e Jun 27 20:02:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f52b921-389e-454d-92b2-c99a9258b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f52b921-389e-454d-92b2-c99a9258b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae42cc1-ff6b-41ae-8523-da5a5b2516ce', 'volume_name': 'volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013ba51e-1168-4244-94b7-b554a6d7a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013ba51e-1168-4244-94b7-b554a6d7a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d76128-87c7-47a3-ae33-d3ddb41e16c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Volume aae42cc1-ff6b-41ae-8523-da5a5b2516ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce', 'volume_size': 1} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-867974595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae42cc1-ff6b-41ae-8523-da5a5b2516ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354789c07824281a0658c28e7e46284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:45Z,use_quota=True,user_id='2c979abaab6f4bc3a0947845d96eb718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Creating volume aae42cc1-ff6b-41ae-8523-da5a5b2516ce {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:02:45 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5f95066c-837b-4b60-a39f-d79e1b0db81e tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "cinder-232bebc7-eeac-4858-bc64-4569c7e2a381-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:45 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce 1073741824 Jun 27 20:02:45 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:46 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea.cc75ae1a-1494-495c-bfdb-b22a007c637e" returned: 0 in 1.370s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-cc75ae1a-1494-495c-bfdb-b22a007c637e" released by "_delete_snapshot" :: held 4.923s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-4cc7d299-244b-46c0-871a-a7d65ed5bdea" released by "delete_snapshot" :: held 4.948s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:46 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['6c6f06ac-6e3e-41d3-a994-0282946ae3d4', 'a5bc185a-22ee-4a62-a7e9-63480bc35b7e', 'cc0f2221-3a5d-4e98-8969-23de85a6e4be', '7f537748-e1a8-427a-92d8-c8f1427febe6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:46 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce 1073741824" returned: 0 in 1.423s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Delete snapshot completed successfully. Jun 27 20:02:47 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce Jun 27 20:02:47 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4ed0157e-6f4c-4c0f-91da-2beeee7481ec tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-cc75ae1a-1494-495c-bfdb-b22a007c637e-delete_snapshot" released by "delete_snapshot" :: held 5.224s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-4cc7d299-244b-46c0-871a-a7d65ed5bdea-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-4cc7d299-244b-46c0-871a-a7d65ed5bdea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-4cc7d299-244b-46c0-871a-a7d65ed5bdea" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-4cc7d299-244b-46c0-871a-a7d65ed5bdea" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757efc1-dd75-4689-981e-1148867b1d9c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:47 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:47 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:48 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce" returned: 0 in 1.033s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] <== create_volume: return (2536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.541s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d76128-87c7-47a3-ae33-d3ddb41e16c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402695d4-3650-45bf-9dfa-8b8399df4221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:48 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Volume volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce (aae42cc1-ff6b-41ae-8523-da5a5b2516ce): created successfully Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402695d4-3650-45bf-9dfa-8b8399df4221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Flow 'volume_create_manager' (8e66cb28-147a-4501-ab31-1e06e0a67569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ae4a1d42-db3c-4b91-bd4b-99409981017b tempest-VolumeQuotasAdminTestJSON-837411502 None] Created volume successfully. Jun 27 20:02:49 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 1.362s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:49 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea Jun 27 20:02:49 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (8045e6ba-e438-4d9f-aa81-205f142dd587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b46cfe-5d95-4bba-af74-4237466aff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b46cfe-5d95-4bba-af74-4237466aff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2106886806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9292b4-ecfe-4296-83f6-c517e07d4342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:50Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901615b7-6070-42d1-956d-2a8263a1a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901615b7-6070-42d1-956d-2a8263a1a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2d17c3-2c3f-4a9e-bd61-12b2d118e308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2d17c3-2c3f-4a9e-bd61-12b2d118e308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9292b4-ecfe-4296-83f6-c517e07d4342', 'volume_name': 'volume-2c9292b4-ecfe-4296-83f6-c517e07d4342', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf68307-4fec-4046-be07-ddf03a229937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf68307-4fec-4046-be07-ddf03a229937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088b0501-a4b8-4616-9c78-ccdd5105c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:49 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Volume 2c9292b4-ecfe-4296-83f6-c517e07d4342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9292b4-ecfe-4296-83f6-c517e07d4342', 'volume_size': 1} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2106886806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9292b4-ecfe-4296-83f6-c517e07d4342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:02:50Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Creating volume 2c9292b4-ecfe-4296-83f6-c517e07d4342 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:02:49 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:02:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:49 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 1073741824 Jun 27 20:02:49 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-46c32b04-8c50-401c-97ad-4cdbd1d4f546 tempest-VolumeQuotasAdminTestJSON-783543301 None] Transfer volume completed successfully. Jun 27 20:02:50 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4cc7d299-244b-46c0-871a-a7d65ed5bdea" returned: 0 in 1.413s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-4cc7d299-244b-46c0-871a-a7d65ed5bdea" released by "delete_volume" :: held 2.878s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['073872b2-d58f-4436-815a-d257c236dd60', 'ab73152e-f1ad-48cb-b0e4-d2e447d3e841', '475f313d-74a0-4f23-b02f-cf2ffa424c10', '8bce41f4-bb37-4131-9e06-c88524741477'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:50 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:50 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:50 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 1073741824" returned: 0 in 1.052s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:51 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 Jun 27 20:02:51 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-e7127819-e08c-45e9-b067-4cfec7c1dbf9-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-e7127819-e08c-45e9-b067-4cfec7c1dbf9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "cinder-quobyte-e7127819-e08c-45e9-b067-4cfec7c1dbf9" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e7127819-e08c-45e9-b067-4cfec7c1dbf9" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a041f-b531-4824-adfc-0268c1761dfc]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Acquiring lock "cinder-aae42cc1-ff6b-41ae-8523-da5a5b2516ce-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Lock "cinder-aae42cc1-ff6b-41ae-8523-da5a5b2516ce-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:51 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 Jun 27 20:02:51 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Acquiring lock "cinder-quobyte-aae42cc1-ff6b-41ae-8523-da5a5b2516ce" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Lock "cinder-quobyte-aae42cc1-ff6b-41ae-8523-da5a5b2516ce" acquired by "delete_volume" :: waited 0.047s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765d757-8652-408c-ac3a-f87abaa6cea4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:52 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce Jun 27 20:02:52 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:52 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.626s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Deleted volume successfully. Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-187327b3-257b-42f5-bdec-ad8e8d85732b tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-4cc7d299-244b-46c0-871a-a7d65ed5bdea-delete_volume" released by "delete_volume" :: held 4.810s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:52 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342" returned: 0 in 1.556s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] <== create_volume: return (2697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088b0501-a4b8-4616-9c78-ccdd5105c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9292b4-ecfe-4296-83f6-c517e07d4342', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa7ece9-551d-4785-bff6-21e56e6d08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:02:52 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Volume volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 (2c9292b4-ecfe-4296-83f6-c517e07d4342): created successfully Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa7ece9-551d-4785-bff6-21e56e6d08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (8045e6ba-e438-4d9f-aa81-205f142dd587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:02:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8c2cfd97-608f-4118-a5d4-e68184780512 tempest-VolumesActionsTest-251209011 None] Created volume successfully. Jun 27 20:02:52 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce" returned: 0 in 1.118s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:52 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9" returned: 0 in 1.429s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:53 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce Jun 27 20:02:53 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:53 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9 Jun 27 20:02:53 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea14e406-00cf-4543-be3b-5b38eff907a4 tempest-VolumesActionsTest-251209011 None] Acquiring lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342" by "attach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea14e406-00cf-4543-be3b-5b38eff907a4 tempest-VolumesActionsTest-251209011 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342" acquired by "attach_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ea14e406-00cf-4543-be3b-5b38eff907a4 tempest-VolumesActionsTest-251209011 None] Attaching volume 2c9292b4-ecfe-4296-83f6-c517e07d4342 to instance 00c52d20-0be8-48f3-af0e-8d1eb1efb291 at mountpoint /dev/vdb on host None. Jun 27 20:02:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ea14e406-00cf-4543-be3b-5b38eff907a4 tempest-VolumesActionsTest-251209011 None] Attach volume completed successfully. Jun 27 20:02:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea14e406-00cf-4543-be3b-5b38eff907a4 tempest-VolumesActionsTest-251209011 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342" released by "attach_volume" :: held 0.210s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:53 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7127819-e08c-45e9-b067-4cfec7c1dbf9" returned: 0 in 0.966s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-quobyte-e7127819-e08c-45e9-b067-4cfec7c1dbf9" released by "delete_volume" :: held 2.544s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:54 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aae42cc1-ff6b-41ae-8523-da5a5b2516ce" returned: 0 in 1.054s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Lock "cinder-quobyte-aae42cc1-ff6b-41ae-8523-da5a5b2516ce" released by "delete_volume" :: held 2.276s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Created reservations ['174ae7e4-d77d-45b5-ab22-702a2ea83440', 'aa095dd7-8516-4e79-b15b-4a347fdad067', '7335f797-9c3f-4a3e-b1fd-f8e313f48c96', '6df5f533-1922-4032-bf83-dfdefbd70ef7'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Created reservations ['e272561d-7abf-4198-a18e-503675dcaa32', '86e444ec-2a6e-4733-937d-d58556b007f7', '1229e30d-9a88-4789-a5c8-260b5ff636b0', 'cae22009-7840-4365-bbe3-bc71b82a9393'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:54 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:54 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c3e6d6ca-3188-4aa1-81c4-d9c526e014c9 tempest-VolumesActionsTest-1083672729 None] Terminate volume connection completed successfully. Jun 27 20:02:54 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:54 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c3e6d6ca-3188-4aa1-81c4-d9c526e014c9 tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-detach_volume" by "detach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c3e6d6ca-3188-4aa1-81c4-d9c526e014c9 tempest-VolumesActionsTest-1083672729 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c3e6d6ca-3188-4aa1-81c4-d9c526e014c9 tempest-VolumesActionsTest-1083672729 None] Detaching volume 2c9292b4-ecfe-4296-83f6-c517e07d4342 from instance 00c52d20-0be8-48f3-af0e-8d1eb1efb291. Jun 27 20:02:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c3e6d6ca-3188-4aa1-81c4-d9c526e014c9 tempest-VolumesActionsTest-1083672729 None] Detach volume completed successfully. Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c3e6d6ca-3188-4aa1-81c4-d9c526e014c9 tempest-VolumesActionsTest-1083672729 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-detach_volume" released by "detach_volume" :: held 0.221s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:55 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.142s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Deleted volume successfully. Jun 27 20:02:55 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.273s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7f5f7b69-de0c-4e68-8b00-00ec2c04f15d tempest-VolumeQuotasAdminTestJSON-361656363 None] Lock "cinder-aae42cc1-ff6b-41ae-8523-da5a5b2516ce-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Deleted volume successfully. Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5b593d07-5921-4528-b4b9-7f69907d3b15 tempest-VolumesSnapshotTestJSON-978396819 None] Lock "cinder-e7127819-e08c-45e9-b067-4cfec7c1dbf9-delete_volume" released by "delete_volume" :: held 4.383s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c676d503-2cf0-4158-8849-cb1470062ef2 tempest-VolumesActionsTest-251209011 None] Acquiring lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-detach_volume" by "detach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c676d503-2cf0-4158-8849-cb1470062ef2 tempest-VolumesActionsTest-251209011 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c676d503-2cf0-4158-8849-cb1470062ef2 tempest-VolumesActionsTest-251209011 None] Volume detach called, but volume not attached. Jun 27 20:02:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c676d503-2cf0-4158-8849-cb1470062ef2 tempest-VolumesActionsTest-251209011 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Acquiring lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Acquiring lock "cinder-quobyte-2c9292b4-ecfe-4296-83f6-c517e07d4342" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:02:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Lock "cinder-quobyte-2c9292b4-ecfe-4296-83f6-c517e07d4342" acquired by "delete_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:02:57 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02264c-ce61-4883-8d24-f8d3fccecd7a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:02:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:57 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 Jun 27 20:02:57 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:58 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342" returned: 0 in 1.321s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:58 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342 Jun 27 20:02:58 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:02:59 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-2c9292b4-ecfe-4296-83f6-c517e07d4342" returned: 0 in 0.976s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Lock "cinder-quobyte-2c9292b4-ecfe-4296-83f6-c517e07d4342" released by "delete_volume" :: held 2.367s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Created reservations ['3c86f5e6-63f1-45d0-a81a-808b4ab6fc53', '691205ab-64a6-4c35-b6e4-437274a56a01', 'b782b8dd-23d2-4c87-86f9-256553f3bb23', '47add411-eac6-4387-96d9-3ef7c49f33eb'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:02:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:02:59 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:02:59 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:00 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.176s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:00 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Deleted volume successfully. Jun 27 20:03:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dc23e623-9cb3-4d06-9312-2f82a9874518 tempest-VolumesActionsTest-251209011 None] Lock "cinder-2c9292b4-ecfe-4296-83f6-c517e07d4342-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Flow 'volume_create_manager' (cb5bb831-6901-4c2e-81a5-9dc425a465c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5175b-c176-42d2-bc96-f223acb19dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5175b-c176-42d2-bc96-f223acb19dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2020586509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fb10a1-a3e1-4026-bdf4-d1cdd1797889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18396186e058405c8f481a620325c49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:04Z,use_quota=True,user_id='aa855b5d248b451294cca6159811ab52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9be54f4-5373-4b91-ae25-7c3f223beb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9be54f4-5373-4b91-ae25-7c3f223beb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90b477-11d4-4732-a2d8-20e98f433d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90b477-11d4-4732-a2d8-20e98f433d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93fb10a1-a3e1-4026-bdf4-d1cdd1797889', 'volume_name': 'volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9caac4-35ba-4e75-8046-7cc6b14c5303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9caac4-35ba-4e75-8046-7cc6b14c5303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7834116-3827-402f-ba34-283450f020ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:04 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Volume 93fb10a1-a3e1-4026-bdf4-d1cdd1797889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889', 'volume_size': 1} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2020586509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fb10a1-a3e1-4026-bdf4-d1cdd1797889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18396186e058405c8f481a620325c49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:04Z,use_quota=True,user_id='aa855b5d248b451294cca6159811ab52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Creating volume 93fb10a1-a3e1-4026-bdf4-d1cdd1797889 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:04 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:04 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 1073741824 Jun 27 20:03:04 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Flow 'volume_create_manager' (f9345990-779b-40c9-91fd-48837c008411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0440afab-9aa8-4be8-8e21-643c91f8555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0440afab-9aa8-4be8-8e21-643c91f8555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-980141210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0d44f5-c123-46c7-9b4b-155cfb369f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf14f139ac35437e9c3af843d3866bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:06Z,use_quota=True,user_id='9423885089754a9f9f083376c165cc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd14a9e-a642-48b7-8131-c02d29c21a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd14a9e-a642-48b7-8131-c02d29c21a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd23326-282c-4c6d-9a5e-3ed65cb11c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd23326-282c-4c6d-9a5e-3ed65cb11c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0d44f5-c123-46c7-9b4b-155cfb369f2a', 'volume_name': 'volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a', 'volume_size': 2}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:05 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a5aa3-ec58-4a68-92d1-f3857eb5722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a5aa3-ec58-4a68-92d1-f3857eb5722f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633c272f-a3e1-4082-8186-7717dc1cdeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Volume ac0d44f5-c123-46c7-9b4b-155cfb369f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a', 'volume_size': 2} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 1073741824" returned: 0 in 1.034s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:05 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 Jun 27 20:03:05 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:06 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889" returned: 0 in 0.650s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-980141210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0d44f5-c123-46c7-9b4b-155cfb369f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf14f139ac35437e9c3af843d3866bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:06Z,use_quota=True,user_id='9423885089754a9f9f083376c165cc47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Creating volume ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:06 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a 2147483648 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7834116-3827-402f-ba34-283450f020ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:06 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a 2147483648 Jun 27 20:03:06 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441c044c-383a-4ea2-9a5d-200d83da144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:06 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Volume volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 (93fb10a1-a3e1-4026-bdf4-d1cdd1797889): created successfully Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441c044c-383a-4ea2-9a5d-200d83da144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Flow 'volume_create_manager' (cb5bb831-6901-4c2e-81a5-9dc425a465c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2ffd6331-f411-4ac4-81da-8bd1430326cb tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Created volume successfully. Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:07 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Flow 'volume_create_manager' (2292f9f7-2f6a-4bf6-811a-8822dcd2382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6622d474-d3ff-4620-8582-ba12f69391ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a 2147483648" returned: 0 in 1.053s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6622d474-d3ff-4620-8582-ba12f69391ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-486587622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5028fc2-21e6-4a55-b7be-0ed4288754e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc14df6e9d647b7b9e3a96fd8dacf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:07Z,use_quota=True,user_id='01e505df7dce41ae9971263ac26ef78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84e794cb-2506-4899-8002-e55917813b4c),volume_type_id=84e794cb-2506-4899-8002-e55917813b4c)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264d99c7-59d1-4764-839d-cbccdeb6dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264d99c7-59d1-4764-839d-cbccdeb6dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc56a713-16d7-4a6b-aa91-c437b2660053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc56a713-16d7-4a6b-aa91-c437b2660053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5028fc2-21e6-4a55-b7be-0ed4288754e6', 'volume_name': 'volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee128e1-b0c0-4bd0-a71d-9f78e01dfcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee128e1-b0c0-4bd0-a71d-9f78e01dfcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0032700d-a7c5-4d56-b9b9-435bf9922350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Volume d5028fc2-21e6-4a55-b7be-0ed4288754e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6', 'volume_size': 1} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:07 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a Jun 27 20:03:07 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Acquiring lock "cinder-93fb10a1-a3e1-4026-bdf4-d1cdd1797889-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "cinder-93fb10a1-a3e1-4026-bdf4-d1cdd1797889-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Acquiring lock "cinder-quobyte-93fb10a1-a3e1-4026-bdf4-d1cdd1797889" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "cinder-quobyte-93fb10a1-a3e1-4026-bdf4-d1cdd1797889" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fe7271-9dac-4ea3-8063-de2ea379b9ea]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:08 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 Jun 27 20:03:08 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:08 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" returned: 0 in 0.766s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-486587622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5028fc2-21e6-4a55-b7be-0ed4288754e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc14df6e9d647b7b9e3a96fd8dacf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:07Z,use_quota=True,user_id='01e505df7dce41ae9971263ac26ef78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84e794cb-2506-4899-8002-e55917813b4c),volume_type_id=84e794cb-2506-4899-8002-e55917813b4c)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Creating volume d5028fc2-21e6-4a55-b7be-0ed4288754e6 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:08 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:08 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 1073741824 Jun 27 20:03:08 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633c272f-a3e1-4082-8186-7717dc1cdeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a', 'volume_size': 2}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178a06ab-0a09-4afd-bb4f-823358334911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:08 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Volume volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a (ac0d44f5-c123-46c7-9b4b-155cfb369f2a): created successfully Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178a06ab-0a09-4afd-bb4f-823358334911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Flow 'volume_create_manager' (f9345990-779b-40c9-91fd-48837c008411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (cf6a9e17-cfb6-4e2a-a7a5-1a9b3bb0e3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27b926b-a046-45d4-9634-05bb9ad79f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2b7312aa-bfbe-4b62-9613-d2cf99da8c7c tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Created volume successfully. Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27b926b-a046-45d4-9634-05bb9ad79f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-422971011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b3c059-9983-443d-9ff8-374282a821f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:08Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24050d78-28af-4ce4-8677-22ef7b42d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24050d78-28af-4ce4-8677-22ef7b42d31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33546a2e-05bc-43b6-ba5b-faf9b728c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33546a2e-05bc-43b6-ba5b-faf9b728c371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b3c059-9983-443d-9ff8-374282a821f6', 'volume_name': 'volume-d0b3c059-9983-443d-9ff8-374282a821f6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b907d960-c4df-40f4-8041-5e03c6fcca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b907d960-c4df-40f4-8041-5e03c6fcca63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8068630e-1022-4663-b543-941c30eb6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:08 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Volume d0b3c059-9983-443d-9ff8-374282a821f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b3c059-9983-443d-9ff8-374282a821f6', 'volume_size': 1} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:08 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889" returned: 0 in 0.828s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:08 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889 Jun 27 20:03:08 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:09 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 1073741824" returned: 0 in 0.876s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:09 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 Jun 27 20:03:09 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:09 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-93fb10a1-a3e1-4026-bdf4-d1cdd1797889" returned: 0 in 0.749s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "cinder-quobyte-93fb10a1-a3e1-4026-bdf4-d1cdd1797889" released by "delete_volume" :: held 1.626s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Created reservations ['e45366ba-302b-4544-90ad-2ad775b009ba', '4e0fc079-309c-46df-8902-079aa99cef79', '38aa6368-5d09-43cc-83e5-1fa56fc74d62', 'cec0950f-5466-4458-8451-9f8e8019c79e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:09 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:09 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:09 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6" returned: 0 in 0.663s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-422971011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b3c059-9983-443d-9ff8-374282a821f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:08Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Creating volume d0b3c059-9983-443d-9ff8-374282a821f6 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:09 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0032700d-a7c5-4d56-b9b9-435bf9922350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:10 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 1073741824 Jun 27 20:03:10 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a967ab-855d-4e59-93bc-a82fbce2aafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:10 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Volume volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 (d5028fc2-21e6-4a55-b7be-0ed4288754e6): created successfully Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a967ab-855d-4e59-93bc-a82fbce2aafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Flow 'volume_create_manager' (2292f9f7-2f6a-4bf6-811a-8822dcd2382d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5c7578b0-34bb-4839-92eb-e614d58d2f56 tempest-VolumeTypesAccessTest-1927197437 None] Created volume successfully. Jun 27 20:03:10 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.722s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Deleted volume successfully. Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fe4230d9-e23d-42da-b313-8a4424c5da77 tempest-VolumeQuotasNegativeTestJSON-1932559448 None] Lock "cinder-93fb10a1-a3e1-4026-bdf4-d1cdd1797889-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Acquiring lock "cinder-d5028fc2-21e6-4a55-b7be-0ed4288754e6-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Lock "cinder-d5028fc2-21e6-4a55-b7be-0ed4288754e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Acquiring lock "cinder-quobyte-d5028fc2-21e6-4a55-b7be-0ed4288754e6" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Lock "cinder-quobyte-d5028fc2-21e6-4a55-b7be-0ed4288754e6" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a074e-b349-45cf-bc16-8747e2083d3e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:10 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 Jun 27 20:03:10 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:10 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 1073741824" returned: 0 in 0.923s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:10 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 Jun 27 20:03:10 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:11 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6" returned: 0 in 0.851s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:11 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6" returned: 0 in 0.714s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:11 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6 Jun 27 20:03:11 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.649s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8068630e-1022-4663-b543-941c30eb6094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b3c059-9983-443d-9ff8-374282a821f6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f7e96f-a49a-42f3-8fd0-09c175aa12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Creating offline snapshot b08b7dfc-b594-46c7-8da9-685e179f3684 of volume ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:03:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Volume volume-d0b3c059-9983-443d-9ff8-374282a821f6 (d0b3c059-9983-443d-9ff8-374282a821f6): created successfully Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f7e96f-a49a-42f3-8fd0-09c175aa12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (cf6a9e17-cfb6-4e2a-a7a5-1a9b3bb0e3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c88039-b121-4b5e-8d71-7df3b5cec527]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-58e9d990-79dc-42c3-8a7c-56131d741fc4 tempest-VolumesActionsTest-251209011 None] Created volume successfully. Jun 27 20:03:11 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a Jun 27 20:03:11 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:12 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d5028fc2-21e6-4a55-b7be-0ed4288754e6" returned: 0 in 0.759s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Lock "cinder-quobyte-d5028fc2-21e6-4a55-b7be-0ed4288754e6" released by "delete_volume" :: held 1.668s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:12 devstack cinder-volume[93503]: WARNING cinder.quota [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1120098750 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1120098750, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:03:12 devstack cinder-volume[93503]: WARNING cinder.quota [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1120098750 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1120098750, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Created reservations ['4a90f05a-ff4f-40e1-8170-98c2c5e9a46d', '90ed186e-dbb3-4995-b68a-fd1b01851372', 'b0ea4ab6-d316-4eee-a14a-d23347098a77', 'acf8ca11-2316-4818-b189-5781222decad'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:12 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" returned: 0 in 0.920s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 2G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:12 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:12 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:12 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 2G Jun 27 20:03:12 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-d0b3c059-9983-443d-9ff8-374282a821f6-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Lock "cinder-d0b3c059-9983-443d-9ff8-374282a821f6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-quobyte-d0b3c059-9983-443d-9ff8-374282a821f6" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-d0b3c059-9983-443d-9ff8-374282a821f6" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52dae2-ff79-44e2-805a-12b3ad687b72]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:13 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 Jun 27 20:03:13 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:13 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:13 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 2G" returned: 0 in 1.042s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.067s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Deleted volume successfully. Jun 27 20:03:13 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 Jun 27 20:03:13 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-31168e2e-5dc2-42ed-a01f-ca6df9cd09ab tempest-VolumeTypesAccessTest-1927197437 None] Lock "cinder-d5028fc2-21e6-4a55-b7be-0ed4288754e6-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:14 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6" returned: 0 in 1.050s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:14 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6 Jun 27 20:03:14 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:14 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684" returned: 0 in 0.889s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:14 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 is being set with open permissions: ugo+rw Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:14 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 Jun 27 20:03:14 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:14 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d0b3c059-9983-443d-9ff8-374282a821f6" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-d0b3c059-9983-443d-9ff8-374282a821f6" released by "delete_volume" :: held 1.847s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Created reservations ['5bd915bb-812a-4936-954a-ff90711cf5fa', '34079c09-0194-4475-9fc5-1bacf1075128', '3f98acd4-ed12-4691-8135-12218b3fcb44', '929f9ead-1d9e-4fab-905f-a608c79621d6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:15 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:15 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684" returned: 0 in 0.880s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:15 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:15 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info Jun 27 20:03:15 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:15 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.989s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:16 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Deleted volume successfully. Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b11e8612-ac13-4506-beab-78cad53bc64b tempest-VolumesActionsTest-1083672729 None] Lock "cinder-d0b3c059-9983-443d-9ff8-374282a821f6-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (20b96572-add8-48ab-bf81-884fcf4d929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052c81f5-07c8-4690-aaff-38ea4e398fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052c81f5-07c8-4690-aaff-38ea4e398fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-939693214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216d250c-635c-49cd-94d5-a162a1bb0888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:16Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aecf97-8c05-40ea-a76a-8e62cafdf92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aecf97-8c05-40ea-a76a-8e62cafdf92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323b4b56-e4b4-46b9-a2aa-fa3a4b9a964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323b4b56-e4b4-46b9-a2aa-fa3a4b9a964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216d250c-635c-49cd-94d5-a162a1bb0888', 'volume_name': 'volume-216d250c-635c-49cd-94d5-a162a1bb0888', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5118b47-bc1f-4244-9cea-0073a47d729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5118b47-bc1f-4244-9cea-0073a47d729a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a4ef39-9975-431d-8b75-b2cd23ab7b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:16 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Volume 216d250c-635c-49cd-94d5-a162a1bb0888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216d250c-635c-49cd-94d5-a162a1bb0888', 'volume_size': 1} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:16 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:16 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:16 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info" returned: 0 in 1.029s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:16 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info is being set with open permissions: ugo+rw Jun 27 20:03:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:16 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info Jun 27 20:03:16 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:17 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.828s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 8 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:03:17 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.info" returned: 0 in 0.869s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.791s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-939693214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216d250c-635c-49cd-94d5-a162a1bb0888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:16Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Creating volume 216d250c-635c-49cd-94d5-a162a1bb0888 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:17 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:17 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 1073741824 Jun 27 20:03:17 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2b3a4171-445d-4896-9134-865212255b23 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Create snapshot completed successfully Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Flow 'volume_create_manager' (fc3e695a-309c-4dad-973f-8a3be35f250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1786cd-8716-4a7e-b4f0-4addacde07b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1786cd-8716-4a7e-b4f0-4addacde07b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-496953818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59b85f7-2097-4d00-a4f7-397231fabfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693ca77b2d2f422499fe29afbe16f2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:18Z,use_quota=True,user_id='00fbe5e6d6d146b590d291ffcac4d483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7b48f9-8d79-4b22-9fad-ad3db04c1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7b48f9-8d79-4b22-9fad-ad3db04c1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d232654-7ed3-40ac-b2df-096995743d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d232654-7ed3-40ac-b2df-096995743d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59b85f7-2097-4d00-a4f7-397231fabfcf', 'volume_name': 'volume-b59b85f7-2097-4d00-a4f7-397231fabfcf', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ab26e9-46b1-4062-9699-39388830a39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ab26e9-46b1-4062-9699-39388830a39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ec07eb-5951-48f8-b7c9-fd0c7e1f4d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:18 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Volume b59b85f7-2097-4d00-a4f7-397231fabfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59b85f7-2097-4d00-a4f7-397231fabfcf', 'volume_size': 1} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:18 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 1073741824" returned: 0 in 0.954s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:18 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 Jun 27 20:03:18 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "cinder-b08b7dfc-b594-46c7-8da9-685e179f3684-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-b08b7dfc-b594-46c7-8da9-685e179f3684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "cinder-quobyte-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-quobyte-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "cinder-quobyte-b08b7dfc-b594-46c7-8da9-685e179f3684" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-quobyte-b08b7dfc-b594-46c7-8da9-685e179f3684" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Deleting offline snapshot b08b7dfc-b594-46c7-8da9-685e179f3684 of volume ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] snapshot_file for this snap is: volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3dfebd-ddf9-48bc-9425-d1e47f57f4f4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:18 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 Jun 27 20:03:18 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:19 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888" returned: 0 in 0.707s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-496953818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59b85f7-2097-4d00-a4f7-397231fabfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693ca77b2d2f422499fe29afbe16f2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:18Z,use_quota=True,user_id='00fbe5e6d6d146b590d291ffcac4d483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Creating volume b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:19 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a4ef39-9975-431d-8b75-b2cd23ab7b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216d250c-635c-49cd-94d5-a162a1bb0888', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cc45cd-155c-42cd-8ef3-6de5db2a1403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:19 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf 1073741824 Jun 27 20:03:19 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:19 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Volume volume-216d250c-635c-49cd-94d5-a162a1bb0888 (216d250c-635c-49cd-94d5-a162a1bb0888): created successfully Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cc45cd-155c-42cd-8ef3-6de5db2a1403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (20b96572-add8-48ab-bf81-884fcf4d929f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e56bd113-c8b8-40a7-a470-3604ab4f867c tempest-VolumesActionsTest-251209011 None] Created volume successfully. Jun 27 20:03:19 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684" returned: 0 in 0.791s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9eda80-3e71-487f-b5f6-a5f4c0fd5d04]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:19 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a Jun 27 20:03:19 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:20 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf 1073741824" returned: 0 in 0.960s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:20 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf Jun 27 20:03:20 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:20 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" returned: 0 in 0.812s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:20 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 Jun 27 20:03:20 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-216d250c-635c-49cd-94d5-a162a1bb0888-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Lock "cinder-216d250c-635c-49cd-94d5-a162a1bb0888-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-quobyte-216d250c-635c-49cd-94d5-a162a1bb0888" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-216d250c-635c-49cd-94d5-a162a1bb0888" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5328086-113a-4df8-ba63-988810673168]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:20 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 Jun 27 20:03:20 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:20 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf" returned: 0 in 0.795s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ec07eb-5951-48f8-b7c9-fd0c7e1f4d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59b85f7-2097-4d00-a4f7-397231fabfcf', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0cce51-8c37-436c-9633-b8ff8f1d8bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:21 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Volume volume-b59b85f7-2097-4d00-a4f7-397231fabfcf (b59b85f7-2097-4d00-a4f7-397231fabfcf): created successfully Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0cce51-8c37-436c-9633-b8ff8f1d8bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Flow 'volume_create_manager' (fc3e695a-309c-4dad-973f-8a3be35f250e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:21 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1f07c415-badb-4425-8ec9-87a93c1ab51d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Created volume successfully. Jun 27 20:03:21 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684" returned: 0 in 0.845s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:21 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684 Jun 27 20:03:21 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:21 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888" returned: 0 in 0.906s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:21 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888 Jun 27 20:03:21 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:21 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a.b08b7dfc-b594-46c7-8da9-685e179f3684" returned: 0 in 0.689s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-quobyte-b08b7dfc-b594-46c7-8da9-685e179f3684" released by "_delete_snapshot" :: held 3.273s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-quobyte-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" released by "delete_snapshot" :: held 3.297s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:21 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Created reservations ['e1882daa-b3eb-40d8-8331-d72164228727', '61829f24-efc4-4bd5-b867-598a3c08e291', '72963ce2-0713-49ca-b28d-0161252a8256', '7c242bba-1bc0-4821-a359-e3bddbc20d71'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:22 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Delete snapshot completed successfully. Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a38e1746-cf5c-4745-946d-93ded6bfce83 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-b08b7dfc-b594-46c7-8da9-685e179f3684-delete_snapshot" released by "delete_snapshot" :: held 3.457s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:22 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216d250c-635c-49cd-94d5-a162a1bb0888" returned: 0 in 0.674s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-216d250c-635c-49cd-94d5-a162a1bb0888" released by "delete_volume" :: held 1.627s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Created reservations ['917a23ba-ff53-4c70-b6cd-39b2fc8c5367', '2aa175da-ebbc-4a99-82ac-588a5c029b19', 'bfe3cbf5-6b3c-4852-9ad6-f996dfb552f6', 'e5846d04-03bf-4ea0-8ae8-af9f198b416e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:22 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:22 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Creating offline snapshot 3ab66b7f-4862-48bc-8f2c-7a7984fc6682 of volume b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32585eff-9ed5-4c17-b915-2e4ba1390fc3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:22 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf Jun 27 20:03:22 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "cinder-ac0d44f5-c123-46c7-9b4b-155cfb369f2a-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-ac0d44f5-c123-46c7-9b4b-155cfb369f2a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:22 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=152,cinder:SELECT=111,cinder:INSERT=35,cinder:DELETE=11 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "cinder-quobyte-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-quobyte-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[12717012-b01b-42d9-9f5d-a7e77c89896c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:23 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.838s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Deleted volume successfully. Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2ef40cc8-d857-4888-987f-52d4d45c80d8 tempest-VolumesActionsTest-1083672729 None] Lock "cinder-216d250c-635c-49cd-94d5-a162a1bb0888-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:23 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a Jun 27 20:03:23 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=148,cinder:SELECT=113,cinder:INSERT=35,cinder:DELETE=9 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (ba9e35e5-42da-4330-8760-c4711b4c09b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7b2248-c789-4ac8-a1e0-53c678b80cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7b2248-c789-4ac8-a1e0-53c678b80cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1299460847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e602f3b-b01a-4da2-9a38-71329a526d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:24Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef6ffeb-78e5-4501-8eb4-f5a9eb5464ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef6ffeb-78e5-4501-8eb4-f5a9eb5464ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ce6e01-f4f7-4c6b-a110-732f40943c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ce6e01-f4f7-4c6b-a110-732f40943c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e602f3b-b01a-4da2-9a38-71329a526d69', 'volume_name': 'volume-4e602f3b-b01a-4da2-9a38-71329a526d69', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:23 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d70923-c4e7-42cf-9a26-1df6d1271ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d70923-c4e7-42cf-9a26-1df6d1271ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e564fa-9fb7-485c-8bd3-bcc9ab8573b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:23 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Volume 4e602f3b-b01a-4da2-9a38-71329a526d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e602f3b-b01a-4da2-9a38-71329a526d69', 'volume_size': 1} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf" returned: 0 in 1.178s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:23 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 1G Jun 27 20:03:23 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:24 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" returned: 0 in 1.085s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:24 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a Jun 27 20:03:24 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:24 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 1G" returned: 0 in 0.924s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b59b85f7-2097-4d00-a4f7-397231fabfcf -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:24 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b59b85f7-2097-4d00-a4f7-397231fabfcf -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 Jun 27 20:03:24 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:24 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-quobyte-ac0d44f5-c123-46c7-9b4b-155cfb369f2a" released by "delete_volume" :: held 1.914s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Created reservations ['2dc41d0a-e26d-4e2a-9ede-ef3eb0f50adf', '2e9dde13-aaea-4a24-970a-28e68f88c876', '41f7a5a2-6f23-4298-8dd4-b65faec33d89', '48fa4a3c-b25e-489d-820b-eb6802adc06c'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:25 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:25 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:25 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b59b85f7-2097-4d00-a4f7-397231fabfcf -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682" returned: 0 in 0.881s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:25 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 is being set with open permissions: ugo+rw Jun 27 20:03:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:25 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 Jun 27 20:03:25 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:26 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.805s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:26 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:26 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Deleted volume successfully. Jun 27 20:03:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6680300-4055-4aac-a8bb-cc9cd99a69d2 tempest-VolumesSnapshotNegativeTestJSON-649622530 None] Lock "cinder-ac0d44f5-c123-46c7-9b4b-155cfb369f2a-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:26 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:26 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info Jun 27 20:03:26 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:27 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info" returned: 0 in 0.768s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:27 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info is being set with open permissions: ugo+rw Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:27 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info Jun 27 20:03:27 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:27 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.info" returned: 0 in 0.754s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.399s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.179s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1299460847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e602f3b-b01a-4da2-9a38-71329a526d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:24Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Creating volume 4e602f3b-b01a-4da2-9a38-71329a526d69 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:27 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:27 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 1073741824 Jun 27 20:03:27 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:27 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-64b064d7-9e33-414b-9f95-c69c19cea47d tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Create snapshot completed successfully Jun 27 20:03:28 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 1073741824" returned: 0 in 1.032s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:29 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 Jun 27 20:03:29 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "cinder-3ab66b7f-4862-48bc-8f2c-7a7984fc6682-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-3ab66b7f-4862-48bc-8f2c-7a7984fc6682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "cinder-quobyte-b59b85f7-2097-4d00-a4f7-397231fabfcf" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-quobyte-b59b85f7-2097-4d00-a4f7-397231fabfcf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "cinder-quobyte-3ab66b7f-4862-48bc-8f2c-7a7984fc6682" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-quobyte-3ab66b7f-4862-48bc-8f2c-7a7984fc6682" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Deleting offline snapshot 3ab66b7f-4862-48bc-8f2c-7a7984fc6682 of volume b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] snapshot_file for this snap is: volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4d691-d990-44ea-bf7a-5c8709a7e168]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:29 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 Jun 27 20:03:29 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:29 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69" returned: 0 in 0.879s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e564fa-9fb7-485c-8bd3-bcc9ab8573b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e602f3b-b01a-4da2-9a38-71329a526d69', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e498857-a57c-447f-8231-919edae9dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:29 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Volume volume-4e602f3b-b01a-4da2-9a38-71329a526d69 (4e602f3b-b01a-4da2-9a38-71329a526d69): created successfully Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e498857-a57c-447f-8231-919edae9dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (ba9e35e5-42da-4330-8760-c4711b4c09b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:29 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5e41b9bd-7f03-46eb-a306-bd82113ebda2 tempest-VolumesActionsTest-251209011 None] Created volume successfully. Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Flow 'volume_create_manager' (2955a599-5608-4531-b39d-005a780a0d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c387aff4-5390-4a1f-880a-f73610b4bfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c387aff4-5390-4a1f-880a-f73610b4bfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-389186109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d4344-b167-4779-9be9-5137cd22b631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ac9946c0894989a8ba55f9b727f825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:30Z,use_quota=True,user_id='b9f82f28ce4746a1b8a023dc9605a71a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885077a5-9f30-4249-9900-cb2aa56edd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885077a5-9f30-4249-9900-cb2aa56edd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a333c63-4faa-4bb5-8da5-0e0e90ee9f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:03:30 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682" returned: 0 in 0.920s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b59b85f7-2097-4d00-a4f7-397231fabfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[876cd7c7-a476-47b8-9c2c-5829357e3d03]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:30 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf Jun 27 20:03:30 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a333c63-4faa-4bb5-8da5-0e0e90ee9f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '200d4344-b167-4779-9be9-5137cd22b631', 'volume_name': 'volume-200d4344-b167-4779-9be9-5137cd22b631', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734b3d27-3fa6-4e4e-bda3-4ff4b5f4772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734b3d27-3fa6-4e4e-bda3-4ff4b5f4772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb98652-ae76-4ac5-8d7b-bb8bf1417c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:30 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Volume 200d4344-b167-4779-9be9-5137cd22b631: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-200d4344-b167-4779-9be9-5137cd22b631', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 20:03:30 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Trying to clone 200d4344-b167-4779-9be9-5137cd22b631 from image 45e3a23f-5037-4170-820b-7e6bcfe7854f at location (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:03:31 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Image download 20.69 MB at 20.69 MB/s Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f73986-f365-46f5-8b3b-8c01663d5d17]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-4e602f3b-b01a-4da2-9a38-71329a526d69-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Lock "cinder-4e602f3b-b01a-4da2-9a38-71329a526d69-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:31 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD Jun 27 20:03:31 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-quobyte-4e602f3b-b01a-4da2-9a38-71329a526d69" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:31 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf" returned: 0 in 1.067s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-4e602f3b-b01a-4da2-9a38-71329a526d69" acquired by "delete_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:31 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 Jun 27 20:03:31 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[50977c72-77b7-4ae4-9541-808e7c7d8be2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:31 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 Jun 27 20:03:31 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:32 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f is fetched for user b9f82f28ce4746a1b8a023dc9605a71a. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[11003294-e685-40f7-92e7-536645a735b4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:32 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD Jun 27 20:03:32 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:32 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682" returned: 0 in 0.851s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:32 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69" returned: 0 in 0.816s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:32 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682 Jun 27 20:03:32 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:32 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69 Jun 27 20:03:32 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:33 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-389186109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d4344-b167-4779-9be9-5137cd22b631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ac9946c0894989a8ba55f9b727f825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:30Z,use_quota=True,user_id='b9f82f28ce4746a1b8a023dc9605a71a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Creating volume 200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:33 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:33 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 1073741824 Jun 27 20:03:33 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:33 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4e602f3b-b01a-4da2-9a38-71329a526d69" returned: 0 in 0.817s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-4e602f3b-b01a-4da2-9a38-71329a526d69" released by "delete_volume" :: held 1.699s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:33 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf.3ab66b7f-4862-48bc-8f2c-7a7984fc6682" returned: 0 in 0.875s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-quobyte-3ab66b7f-4862-48bc-8f2c-7a7984fc6682" released by "_delete_snapshot" :: held 3.887s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-quobyte-b59b85f7-2097-4d00-a4f7-397231fabfcf" released by "delete_snapshot" :: held 3.917s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Created reservations ['e7e0cf38-cbfd-4204-95b3-dc7c980c5864', '081fee5b-e178-4a3c-bc91-22fbbf9b3ec4', 'e143e27a-928d-4f7c-8853-18a5d2e9361d', '4314d77b-ad89-4809-b781-eb2fd9d19e7f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Created reservations ['1a337e2e-b294-46d8-984a-3d212898bbf2', 'b05472db-b1a3-41eb-ac6c-c131cf41e04c', 'bbe0f89c-e192-445f-bcc7-2534558d3087', '3b328126-eeb1-40e3-bde4-0f1a7b581928'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:33 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:33 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Delete snapshot completed successfully. Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c02dddea-a6e7-4d3f-be4c-c8f1d2df13dc tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-3ab66b7f-4862-48bc-8f2c-7a7984fc6682-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "cinder-b59b85f7-2097-4d00-a4f7-397231fabfcf-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-b59b85f7-2097-4d00-a4f7-397231fabfcf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "cinder-quobyte-b59b85f7-2097-4d00-a4f7-397231fabfcf" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-quobyte-b59b85f7-2097-4d00-a4f7-397231fabfcf" acquired by "delete_volume" :: waited 0.031s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ca5fc-461b-4e8d-b819-85647c7e59d3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:34 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf Jun 27 20:03:34 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:34 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 1073741824" returned: 0 in 1.470s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (49d870ee-3ebf-4bc9-bb1f-0e1389d2dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee295055-45b5-4903-a827-d4d8c813c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee295055-45b5-4903-a827-d4d8c813c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055266495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcf3b70-a92a-4045-9cc0-b252b606144e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:35Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2594ce-342a-45ca-869f-a8b555af6c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2594ce-342a-45ca-869f-a8b555af6c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:34 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea749d5d-561f-46fb-8608-f727126f3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:34 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea749d5d-561f-46fb-8608-f727126f3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcf3b70-a92a-4045-9cc0-b252b606144e', 'volume_name': 'volume-6bcf3b70-a92a-4045-9cc0-b252b606144e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cb09a5-53e4-4ed6-b753-ebaf4c303ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cb09a5-53e4-4ed6-b753-ebaf4c303ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ef53ff-162c-469d-8d09-3f6afd1490ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Volume 6bcf3b70-a92a-4045-9cc0-b252b606144e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcf3b70-a92a-4045-9cc0-b252b606144e', 'volume_size': 1} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:34 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.344s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:34 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Deleted volume successfully. Jun 27 20:03:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-48b4e33b-7079-4625-a041-9eb08e16a51e tempest-VolumesActionsTest-1083672729 None] Lock "cinder-4e602f3b-b01a-4da2-9a38-71329a526d69-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:35 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf" returned: 0 in 1.222s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:35 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf Jun 27 20:03:35 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:35 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 0 in 0.722s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055266495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcf3b70-a92a-4045-9cc0-b252b606144e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:35Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Creating volume 6bcf3b70-a92a-4045-9cc0-b252b606144e {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:35 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Attempting download of 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 200d4344-b167-4779-9be9-5137cd22b631. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:03:35 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e 1073741824 Jun 27 20:03:35 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4d9099-f1b5-4f50-8b78-e88b5a56653f]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:35 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy Jun 27 20:03:35 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:36 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b59b85f7-2097-4d00-a4f7-397231fabfcf" returned: 0 in 0.823s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-quobyte-b59b85f7-2097-4d00-a4f7-397231fabfcf" released by "delete_volume" :: held 2.159s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Created reservations ['7f2dd37e-07d3-4109-8a27-0176d478ffba', '8780aaa8-cf60-4f95-82f5-687cf5bdb159', '5338b3e4-24ec-4632-80bc-b2932ff2224c', 'df2f0046-2c89-4eee-ba37-7dc98eda15fc'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:36 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:36 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:36 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy" returned: 0 in 0.799s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:36 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy Jun 27 20:03:36 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:36 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e 1073741824" returned: 0 in 1.241s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:36 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e Jun 27 20:03:36 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:37 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.937s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Deleted volume successfully. Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5a943e2e-3402-46e0-a222-5536f0c2f320 tempest-VolumeSnapshotQuotasNegativeTestJSON-1891289328 None] Lock "cinder-b59b85f7-2097-4d00-a4f7-397231fabfcf-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:37 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy" returned: 1 in 1.019s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_t0h8avsy' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bccc35a-5e73-4519-9502-274c4ee312cb]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:37 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD Jun 27 20:03:37 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:37 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e" returned: 0 in 0.876s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ef53ff-162c-469d-8d09-3f6afd1490ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcf3b70-a92a-4045-9cc0-b252b606144e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb11510-8311-43ff-9e41-ba718e517366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:37 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Volume volume-6bcf3b70-a92a-4045-9cc0-b252b606144e (6bcf3b70-a92a-4045-9cc0-b252b606144e): created successfully Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb11510-8311-43ff-9e41-ba718e517366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (49d870ee-3ebf-4bc9-bb1f-0e1389d2dd66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b7bacd47-b206-4467-8fdf-4b06ba907fa3 tempest-VolumesActionsTest-251209011 None] Created volume successfully. Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-6bcf3b70-a92a-4045-9cc0-b252b606144e-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Lock "cinder-6bcf3b70-a92a-4045-9cc0-b252b606144e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Acquiring lock "cinder-quobyte-6bcf3b70-a92a-4045-9cc0-b252b606144e" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-6bcf3b70-a92a-4045-9cc0-b252b606144e" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f93488-58a7-4bd9-94d1-e512094e0444]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:38 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] 45e3a23f-5037-4170-820b-7e6bcfe7854f was qcow2, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:03:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:38 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:38 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:38 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e Jun 27 20:03:38 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:39 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e" returned: 0 in 1.083s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:39 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e Jun 27 20:03:39 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:40 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6bcf3b70-a92a-4045-9cc0-b252b606144e" returned: 0 in 0.830s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Lock "cinder-quobyte-6bcf3b70-a92a-4045-9cc0-b252b606144e" released by "delete_volume" :: held 1.993s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Created reservations ['eca11c4d-948a-423d-965b-313d9dec7723', '085a85de-c540-47ad-986a-7924070d7df8', '8725701c-99e9-4a83-8dd5-01865a97b2df', '06aa9de0-42d3-4215-ae81-ba93b5e6cbbf'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:40 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:40 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:41 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 0 in 2.766s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:41 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_y4e5k3uxdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:03:41 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Converted 112.00 MB image at 40.44 MB/s Jun 27 20:03:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:41 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 1G Jun 27 20:03:41 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:41 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:41 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:41 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Deleted volume successfully. Jun 27 20:03:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-43ec8ca3-678d-4d98-a493-8e80bde06c1f tempest-VolumesActionsTest-1083672729 None] Lock "cinder-6bcf3b70-a92a-4045-9cc0-b252b606144e-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:42 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 1G" returned: 0 in 1.051s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (1ceb2833-4357-49d8-9a6d-eb2ce2b27ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb6b1f7-b92a-4759-aad7-7df9029e3024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c0b8d3-a6ff-4aca-9420-2ca2df4576e3]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb6b1f7-b92a-4759-aad7-7df9029e3024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1224724711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5936a1cb-73d8-44b9-a361-b8a79b31263d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:42Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a044e73-b680-466d-ac7e-771d42623735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a044e73-b680-466d-ac7e-771d42623735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf45e984-100c-414d-9f60-34445418ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf45e984-100c-414d-9f60-34445418ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5936a1cb-73d8-44b9-a361-b8a79b31263d', 'volume_name': 'volume-5936a1cb-73d8-44b9-a361-b8a79b31263d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6085049c-e0ec-4865-9ece-25f88f6d5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6085049c-e0ec-4865-9ece-25f88f6d5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beeeef5f-0d6a-41cf-a0ce-840ace4da9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:42 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Volume 5936a1cb-73d8-44b9-a361-b8a79b31263d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5936a1cb-73d8-44b9-a361-b8a79b31263d', 'volume_size': 1} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1224724711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5936a1cb-73d8-44b9-a361-b8a79b31263d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c866d775e7d450c906dbc336bf09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:42Z,use_quota=True,user_id='5611f5917e2e43f7ae9391b52ab5aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Creating volume 5936a1cb-73d8-44b9-a361-b8a79b31263d {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:42 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:42 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d 1073741824 Jun 27 20:03:42 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:42 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:42 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:43 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 0 in 0.896s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:43 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:43 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:43 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d 1073741824" returned: 0 in 1.046s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:43 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d Jun 27 20:03:43 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:44 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 1 in 0.923s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Downloaded image 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 200d4344-b167-4779-9be9-5137cd22b631 successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f for user b9f82f28ce4746a1b8a023dc9605a71a is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Marking volume 200d4344-b167-4779-9be9-5137cd22b631 as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Copying metadata from image 45e3a23f-5037-4170-820b-7e6bcfe7854f to 200d4344-b167-4779-9be9-5137cd22b631. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Creating volume glance metadata for volume 200d4344-b167-4779-9be9-5137cd22b631 backed by image 45e3a23f-5037-4170-820b-7e6bcfe7854f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb98652-ae76-4ac5-8d7b-bb8bf1417c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200d4344-b167-4779-9be9-5137cd22b631', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d23803f-1079-437c-8344-a4828f6e2604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:44 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Volume volume-200d4344-b167-4779-9be9-5137cd22b631 (200d4344-b167-4779-9be9-5137cd22b631): created successfully Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d23803f-1079-437c-8344-a4828f6e2604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Flow 'volume_create_manager' (2955a599-5608-4531-b39d-005a780a0d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-71a4fc80-ddf3-47f2-a77b-177ce652c69c tempest-VolumesImageMetadata-854675471 None] Created volume successfully. Jun 27 20:03:44 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d" returned: 0 in 0.966s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beeeef5f-0d6a-41cf-a0ce-840ace4da9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5936a1cb-73d8-44b9-a361-b8a79b31263d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936d7375-c5bf-44bd-af0c-59aa6f511799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:44 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Volume volume-5936a1cb-73d8-44b9-a361-b8a79b31263d (5936a1cb-73d8-44b9-a361-b8a79b31263d): created successfully Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936d7375-c5bf-44bd-af0c-59aa6f511799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Flow 'volume_create_manager' (1ceb2833-4357-49d8-9a6d-eb2ce2b27ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7f46b6ce-2377-4060-b7b8-9a514e484fc4 tempest-VolumesActionsTest-251209011 None] Created volume successfully. Jun 27 20:03:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Acquiring lock "cinder-200d4344-b167-4779-9be9-5137cd22b631-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Lock "cinder-200d4344-b167-4779-9be9-5137cd22b631-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Acquiring lock "cinder-quobyte-200d4344-b167-4779-9be9-5137cd22b631" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Lock "cinder-quobyte-200d4344-b167-4779-9be9-5137cd22b631" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:45 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e764b-e41a-4734-9c79-b6f1a49dc69b]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:45 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:45 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 0 in 1.062s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:46 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Acquiring lock "cinder-5936a1cb-73d8-44b9-a361-b8a79b31263d-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Lock "cinder-5936a1cb-73d8-44b9-a361-b8a79b31263d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Acquiring lock "cinder-quobyte-5936a1cb-73d8-44b9-a361-b8a79b31263d" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Lock "cinder-quobyte-5936a1cb-73d8-44b9-a361-b8a79b31263d" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:03:46 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:46 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1b975a-5a00-42b4-bb8d-9dfbb8d08aac]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:03:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:46 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d Jun 27 20:03:46 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:47 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 1 in 1.050s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:03:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:47 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631 Jun 27 20:03:47 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:47 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d" returned: 0 in 1.032s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:47 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d Jun 27 20:03:47 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:48 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-200d4344-b167-4779-9be9-5137cd22b631" returned: 0 in 0.770s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Lock "cinder-quobyte-200d4344-b167-4779-9be9-5137cd22b631" released by "delete_volume" :: held 2.978s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Created reservations ['5e677892-7ec3-43f8-bc1e-76d9916a34ff', '84246080-5830-41e4-bec7-4c7ab4065969', '9e7078f7-0597-4d3a-b706-2db87030ea03', 'ac60ac70-4b51-4dae-9f94-335e6dafe3ee'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:48 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:48 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:48 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5936a1cb-73d8-44b9-a361-b8a79b31263d" returned: 0 in 0.917s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Lock "cinder-quobyte-5936a1cb-73d8-44b9-a361-b8a79b31263d" released by "delete_volume" :: held 2.019s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Created reservations ['950164a2-18a7-4aaf-9891-1a0d3408ca6d', '4b5263ad-e625-484f-9f9a-426ecd127c4b', '01723a4f-f66d-45d5-b6a0-3843d449390d', '0b57742e-e733-49f4-9667-1b0507672f64'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:48 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:03:48 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:03:49 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.067s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:49 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Deleted volume successfully. Jun 27 20:03:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-79fefd19-9c93-40af-a3ee-119dd47292a2 tempest-VolumesImageMetadata-854675471 None] Lock "cinder-200d4344-b167-4779-9be9-5137cd22b631-delete_volume" released by "delete_volume" :: held 4.353s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:49 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jun 27 20:03:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.739s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:03:49 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:03:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Deleted volume successfully. Jun 27 20:03:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ba4097ef-a967-48fb-a651-e23bb424352e tempest-VolumesActionsTest-251209011 None] Lock "cinder-5936a1cb-73d8-44b9-a361-b8a79b31263d-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:03:58 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Flow 'volume_create_manager' (2d17fcbc-3e9c-4f69-b7be-894281b448ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa38111-dc4d-4b8a-bc6b-dda1b739f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa38111-dc4d-4b8a-bc6b-dda1b739f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1983834087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edab1ef-3d3a-4086-bc76-90b0177765d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608e644b56df4b928e0a1057dbeb71e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:59Z,use_quota=True,user_id='289d6f2f1f204e588a3b04879f7849d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b936f8-a0bc-4b32-9dc6-408ae9c700f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b936f8-a0bc-4b32-9dc6-408ae9c700f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a2cf4c-df66-44bf-b58e-56876a4b9965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a2cf4c-df66-44bf-b58e-56876a4b9965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6edab1ef-3d3a-4086-bc76-90b0177765d0', 'volume_name': 'volume-6edab1ef-3d3a-4086-bc76-90b0177765d0', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9ffd3a-85a8-426b-8f98-edcf73813965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9ffd3a-85a8-426b-8f98-edcf73813965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ab4720-4bf8-4f95-b782-4d476f474409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:03:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Volume 6edab1ef-3d3a-4086-bc76-90b0177765d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6edab1ef-3d3a-4086-bc76-90b0177765d0', 'volume_size': 1} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1983834087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edab1ef-3d3a-4086-bc76-90b0177765d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608e644b56df4b928e0a1057dbeb71e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:03:59Z,use_quota=True,user_id='289d6f2f1f204e588a3b04879f7849d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Creating volume 6edab1ef-3d3a-4086-bc76-90b0177765d0 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:03:59 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:03:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:03:59 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 1073741824 Jun 27 20:03:59 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:00 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 1073741824" returned: 0 in 1.161s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:00 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 Jun 27 20:04:00 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Flow 'volume_create_manager' (f85f06f0-fb9b-4860-ae4c-782f620b070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:01 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c3dc0c-8ec5-4c66-abaf-89414e09755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0" returned: 0 in 1.127s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c3dc0c-8ec5-4c66-abaf-89414e09755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-399542547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9e6f09-9d45-498f-b8b3-c45c0dab589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96cd2b4faa4f24a4a90fdc48b5a932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:01Z,use_quota=True,user_id='a3723a5c9eae4b10b2b58b7ab5b5aca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fc0384b-73ef-4230-abbd-6b1b0fa89150),volume_type_id=5fc0384b-73ef-4230-abbd-6b1b0fa89150)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319ab0bb-3ceb-4a15-8dd3-14675477b62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319ab0bb-3ceb-4a15-8dd3-14675477b62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0ab911-0a6b-4be1-ab74-13f298867bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0ab911-0a6b-4be1-ab74-13f298867bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9e6f09-9d45-498f-b8b3-c45c0dab589f', 'volume_name': 'volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7813ea-b517-40cc-8819-4716c2c7af2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7813ea-b517-40cc-8819-4716c2c7af2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6100b2a2-9178-4d76-8070-f8ef5af69115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume 3e9e6f09-9d45-498f-b8b3-c45c0dab589f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f', 'volume_size': 1} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-399542547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9e6f09-9d45-498f-b8b3-c45c0dab589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96cd2b4faa4f24a4a90fdc48b5a932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:01Z,use_quota=True,user_id='a3723a5c9eae4b10b2b58b7ab5b5aca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fc0384b-73ef-4230-abbd-6b1b0fa89150),volume_type_id=5fc0384b-73ef-4230-abbd-6b1b0fa89150)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Creating volume 3e9e6f09-9d45-498f-b8b3-c45c0dab589f {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:01 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:01 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f 1073741824 Jun 27 20:04:01 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ab4720-4bf8-4f95-b782-4d476f474409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6edab1ef-3d3a-4086-bc76-90b0177765d0', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78204779-081b-4a86-abfe-b99afad2d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Volume volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 (6edab1ef-3d3a-4086-bc76-90b0177765d0): created successfully Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78204779-081b-4a86-abfe-b99afad2d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Flow 'volume_create_manager' (2d17fcbc-3e9c-4f69-b7be-894281b448ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:01 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fcfa1870-41bb-441c-904e-b1ddb0b30a46 tempest-VolumesTransfersV357Test-1594386386 None] Created volume successfully. Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Flow 'volume_create_manager' (05a91aa6-975d-484d-b652-705c72ad3fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c318c332-0dd7-4a07-be6d-7d34a0230d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Flow 'volume_create_manager' (a78194ab-3a92-4990-a89d-433e17304257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a687d797-9c36-4e64-9491-5b08a475bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a687d797-9c36-4e64-9491-5b08a475bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-990265296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32fe07a-8a0e-4d51-a127-d54b47a3d70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96cd2b4faa4f24a4a90fdc48b5a932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:02Z,use_quota=True,user_id='a3723a5c9eae4b10b2b58b7ab5b5aca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28428f52-024e-4cde-bdf1-a521d6fee6ad),volume_type_id=28428f52-024e-4cde-bdf1-a521d6fee6ad)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be1e0d0-d44f-4a81-80fc-3426f62d887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be1e0d0-d44f-4a81-80fc-3426f62d887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4253f2d-11b2-4993-b5af-32fc06830e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4253f2d-11b2-4993-b5af-32fc06830e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32fe07a-8a0e-4d51-a127-d54b47a3d70b', 'volume_name': 'volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ccb787-698d-4d39-b6d4-d34796a26c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ccb787-698d-4d39-b6d4-d34796a26c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cab78dc-b8a3-40fb-a173-d99f4b3f824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume e32fe07a-8a0e-4d51-a127-d54b47a3d70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b', 'volume_size': 1} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c318c332-0dd7-4a07-be6d-7d34a0230d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1764944711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16e9878-c576-40eb-b4cc-3e6a34e3ee13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4028d221ec3443a593fd92285bacae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:02Z,use_quota=True,user_id='a3b06ed9e9924ce38399e134f9908863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c11f5d-0e80-4800-bc6a-3bbdbfe98fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c11f5d-0e80-4800-bc6a-3bbdbfe98fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815297b1-0243-4b06-b3f4-fd38334e9746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815297b1-0243-4b06-b3f4-fd38334e9746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16e9878-c576-40eb-b4cc-3e6a34e3ee13', 'volume_name': 'volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484858b4-0186-4748-93fa-95f2fa9038da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484858b4-0186-4748-93fa-95f2fa9038da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4add7ca7-fe6e-45e0-b413-96d430874ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:02 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Volume d16e9878-c576-40eb-b4cc-3e6a34e3ee13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13', 'volume_size': 1} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f 1073741824" returned: 0 in 1.121s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:02 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:02 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f Jun 27 20:04:02 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Flow 'volume_create_manager' (107cfd35-86a4-4ff4-9b59-c980b2d9535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a30f4e5-320f-4ae3-be19-c9857cd97159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a30f4e5-320f-4ae3-be19-c9857cd97159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1958931275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=defe514a-af16-4406-b358-58425de18998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96cd2b4faa4f24a4a90fdc48b5a932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:03Z,use_quota=True,user_id='a3723a5c9eae4b10b2b58b7ab5b5aca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(892af9f7-1e7c-4607-99be-f24486b0fe45),volume_type_id=892af9f7-1e7c-4607-99be-f24486b0fe45)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b14b0a4-8e19-41b3-b99b-fca5a22e70c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b14b0a4-8e19-41b3-b99b-fca5a22e70c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea6500a-115d-42d2-9cfc-c3918fe1cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:04:03 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" returned: 0 in 0.831s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.220s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-990265296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32fe07a-8a0e-4d51-a127-d54b47a3d70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96cd2b4faa4f24a4a90fdc48b5a932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:02Z,use_quota=True,user_id='a3723a5c9eae4b10b2b58b7ab5b5aca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28428f52-024e-4cde-bdf1-a521d6fee6ad),volume_type_id=28428f52-024e-4cde-bdf1-a521d6fee6ad)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Creating volume e32fe07a-8a0e-4d51-a127-d54b47a3d70b {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:03 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:03 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b 1073741824 Jun 27 20:04:03 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6100b2a2-9178-4d76-8070-f8ef5af69115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e9369b-ede8-47c1-80c2-cc69b406938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:03 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f (3e9e6f09-9d45-498f-b8b3-c45c0dab589f): created successfully Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e9369b-ede8-47c1-80c2-cc69b406938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Flow 'volume_create_manager' (f85f06f0-fb9b-4860-ae4c-782f620b070c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1fe4d102-0ec2-4bce-b1df-99fa5340f6f8 tempest-TestInstancesWithCinderVolumes-829353016 None] Created volume successfully. Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea6500a-115d-42d2-9cfc-c3918fe1cf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'defe514a-af16-4406-b358-58425de18998', 'volume_name': 'volume-defe514a-af16-4406-b358-58425de18998', 'volume_size': 1, 'image_id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--728242213', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f96cd2b4faa4f24a4a90fdc48b5a932', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'created_at': datetime.datetime(2026, 6, 27, 18, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6/file', 'properties': {}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f22f303-2ba5-4694-bb00-9d20826fecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f22f303-2ba5-4694-bb00-9d20826fecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1488d0-188f-4c88-850a-d34d4bd4ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:03 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume defe514a-af16-4406-b358-58425de18998: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-defe514a-af16-4406-b358-58425de18998', 'volume_size': 1, 'image_id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--728242213', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f96cd2b4faa4f24a4a90fdc48b5a932', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'created_at': datetime.datetime(2026, 6, 27, 18, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6/file', 'properties': {}}, 'image_service': } Jun 27 20:04:03 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Trying to clone defe514a-af16-4406-b358-58425de18998 from image 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:04:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8be104d7-b596-4cdb-89fd-04366756655f tempest-VolumesTransfersV357Test-1549793095 None] Transfer volume completed successfully. Jun 27 20:04:04 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b 1073741824" returned: 0 in 1.061s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:04 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b Jun 27 20:04:04 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Acquiring lock "cinder-6edab1ef-3d3a-4086-bc76-90b0177765d0-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-6edab1ef-3d3a-4086-bc76-90b0177765d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Acquiring lock "cinder-quobyte-6edab1ef-3d3a-4086-bc76-90b0177765d0" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-quobyte-6edab1ef-3d3a-4086-bc76-90b0177765d0" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898931f-ecfb-48ba-8917-343c9324ba2a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:05 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 Jun 27 20:04:05 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Flow 'volume_create_manager' (af7d7b0b-bef9-4cc6-aa99-3d59ebe15d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69d8a4-589d-4bf9-9bf8-888f99a1a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69d8a4-589d-4bf9-9bf8-888f99a1a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-819027742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71d0e9e057a4128b593372a7e37aa6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:05Z,use_quota=True,user_id='b10e529a7cc14a2da53c81fa3ce2d96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f63155-8ab4-4adb-9e9e-240d7986352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f63155-8ab4-4adb-9e9e-240d7986352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f8ee57-79e7-4e55-9fb8-b014dfb6f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f8ee57-79e7-4e55-9fb8-b014dfb6f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf', 'volume_name': 'volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec30604-cac4-474c-ac0d-54f312c65610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec30604-cac4-474c-ac0d-54f312c65610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c05d6d-e0ae-4b70-889a-284c4653007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Volume f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf', 'volume_size': 1} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:05 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" returned: 0 in 0.829s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1764944711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16e9878-c576-40eb-b4cc-3e6a34e3ee13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4028d221ec3443a593fd92285bacae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:02Z,use_quota=True,user_id='a3b06ed9e9924ce38399e134f9908863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Creating volume d16e9878-c576-40eb-b4cc-3e6a34e3ee13 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:05 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cab78dc-b8a3-40fb-a173-d99f4b3f824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:05 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 1073741824 Jun 27 20:04:05 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e85829-3f8b-4c2c-8ec1-a55fdfd35b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b (e32fe07a-8a0e-4d51-a127-d54b47a3d70b): created successfully Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e85829-3f8b-4c2c-8ec1-a55fdfd35b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Flow 'volume_create_manager' (a78194ab-3a92-4990-a89d-433e17304257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c7aa5f5f-b9fe-4024-ab10-970c01d32007 tempest-TestInstancesWithCinderVolumes-829353016 None] Created volume successfully. Jun 27 20:04:05 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0" returned: 0 in 0.844s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:06 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0 Jun 27 20:04:06 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:06 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 1073741824" returned: 0 in 0.996s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:06 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 Jun 27 20:04:06 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:06 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6edab1ef-3d3a-4086-bc76-90b0177765d0" returned: 0 in 0.730s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-quobyte-6edab1ef-3d3a-4086-bc76-90b0177765d0" released by "delete_volume" :: held 1.641s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Created reservations ['4d3f7177-c781-4646-9f4f-f00f274039f7', 'dda19a9a-3b9c-4c29-a3f0-b958abaaaa33', '516784bd-2e13-4749-a3aa-422f76586f6a', 'd09c89e1-c39d-4f87-ad56-3d51a982c0b7'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:06 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:06 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:07 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13" returned: 0 in 0.676s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-819027742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71d0e9e057a4128b593372a7e37aa6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:05Z,use_quota=True,user_id='b10e529a7cc14a2da53c81fa3ce2d96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Creating volume f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:07 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:07 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf 1073741824 Jun 27 20:04:07 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4add7ca7-fe6e-45e0-b413-96d430874ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc8b60a-8b94-4497-842d-14f8914aaeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Volume volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 (d16e9878-c576-40eb-b4cc-3e6a34e3ee13): created successfully Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc8b60a-8b94-4497-842d-14f8914aaeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Flow 'volume_create_manager' (05a91aa6-975d-484d-b652-705c72ad3fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5042d10c-06ab-4942-9afe-03da06a3fa01 tempest-VolumesListAdminTestJSON-1046995770 None] Created volume successfully. Jun 27 20:04:07 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Deleted volume successfully. Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e9ecc045-986e-411a-9227-c60126df60ee tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-6edab1ef-3d3a-4086-bc76-90b0177765d0-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Flow 'volume_create_manager' (d37e4b6a-a8d8-42b6-a827-a918c6acdf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4096ae30-2ff6-4924-add2-3633dcc4abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4096ae30-2ff6-4924-add2-3633dcc4abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1629155744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc1761e-701a-4b27-99f4-16fa5dd96b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608e644b56df4b928e0a1057dbeb71e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:08Z,use_quota=True,user_id='289d6f2f1f204e588a3b04879f7849d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9007ba-249e-44f3-b6ea-1a2e77d98613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9007ba-249e-44f3-b6ea-1a2e77d98613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27247dc8-bae2-4743-ae7d-44a18b33efe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27247dc8-bae2-4743-ae7d-44a18b33efe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc1761e-701a-4b27-99f4-16fa5dd96b1e', 'volume_name': 'volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089ab1e2-30b9-4950-bf6b-fadce3acea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089ab1e2-30b9-4950-bf6b-fadce3acea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d322a4b4-c6d8-443c-aa09-8a1a6a4459bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:08 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Volume 8bc1761e-701a-4b27-99f4-16fa5dd96b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e', 'volume_size': 1} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD, size 20.69 MB, duration 4.42 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:04:08 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Image download 20.69 MB at 4.68 MB/s Jun 27 20:04:08 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf 1073741824" returned: 0 in 0.987s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cdbf2b-3c12-4f07-a8f0-202a0b1b963d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:08 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf Jun 27 20:04:08 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:08 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD Jun 27 20:04:08 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Flow 'volume_create_manager' (06dfa2be-7b83-4e6f-942c-3e74bef3f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:08 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a9e79-e33a-4843-816b-d4522286e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf" returned: 0 in 0.699s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:08 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1629155744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc1761e-701a-4b27-99f4-16fa5dd96b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608e644b56df4b928e0a1057dbeb71e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:08Z,use_quota=True,user_id='289d6f2f1f204e588a3b04879f7849d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Creating volume 8bc1761e-701a-4b27-99f4-16fa5dd96b1e {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:08 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a9e79-e33a-4843-816b-d4522286e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2105975645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d3e329-a602-41f1-ba84-160ac0c97685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4028d221ec3443a593fd92285bacae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:09Z,use_quota=True,user_id='a3b06ed9e9924ce38399e134f9908863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:09 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e 1073741824 Jun 27 20:04:09 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e61bcac-f626-45c5-be0c-b69282d25566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e61bcac-f626-45c5-be0c-b69282d25566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114f7fa2-57cc-4876-a3bb-900713257616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114f7fa2-57cc-4876-a3bb-900713257616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d3e329-a602-41f1-ba84-160ac0c97685', 'volume_name': 'volume-73d3e329-a602-41f1-ba84-160ac0c97685', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbfa4c3-9c99-45d2-8e0a-d15b2e1f51d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbfa4c3-9c99-45d2-8e0a-d15b2e1f51d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fb8996-c024-49d1-9d1c-894793fb0bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:09 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Volume 73d3e329-a602-41f1-ba84-160ac0c97685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d3e329-a602-41f1-ba84-160ac0c97685', 'volume_size': 1} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Temporary image 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 is fetched for user a3723a5c9eae4b10b2b58b7ab5b5aca3. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c05d6d-e0ae-4b70-889a-284c4653007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cef175-d6d6-45c8-9f3a-2f07dae95250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:09 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Volume volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf (f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf): created successfully Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cef175-d6d6-45c8-9f3a-2f07dae95250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Flow 'volume_create_manager' (af7d7b0b-bef9-4cc6-aa99-3d59ebe15d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-10e6ed4b-2d57-402f-8208-9baa982d8784 tempest-VolumesMetadataTest-812945162 None] Created volume successfully. Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b3555-ed52-495b-ac21-44be2e9c24d8]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:09 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD Jun 27 20:04:09 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:09 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:09 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e 1073741824" returned: 0 in 0.899s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:09 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e Jun 27 20:04:09 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Acquiring lock "cinder-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Lock "cinder-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Acquiring lock "cinder-quobyte-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Lock "cinder-quobyte-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[90530b2c-6409-442a-a0b1-b6319f259866]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:10 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf Jun 27 20:04:10 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:10 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e" returned: 0 in 0.648s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.523s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2105975645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d3e329-a602-41f1-ba84-160ac0c97685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4028d221ec3443a593fd92285bacae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:09Z,use_quota=True,user_id='a3b06ed9e9924ce38399e134f9908863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Creating volume 73d3e329-a602-41f1-ba84-160ac0c97685 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:10 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:10 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 1073741824 Jun 27 20:04:10 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d322a4b4-c6d8-443c-aa09-8a1a6a4459bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb1707-8467-46cb-a943-d85b84e24df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:10 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Volume volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e (8bc1761e-701a-4b27-99f4-16fa5dd96b1e): created successfully Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb1707-8467-46cb-a943-d85b84e24df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Flow 'volume_create_manager' (d37e4b6a-a8d8-42b6-a827-a918c6acdf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-86b0a76f-98fd-40b4-b01e-72df566ff3e6 tempest-VolumesTransfersV357Test-1594386386 None] Created volume successfully. Jun 27 20:04:11 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf" returned: 0 in 0.771s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:11 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf Jun 27 20:04:11 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Acquiring lock "cinder-8bc1761e-701a-4b27-99f4-16fa5dd96b1e-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-8bc1761e-701a-4b27-99f4-16fa5dd96b1e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Acquiring lock "cinder-quobyte-8bc1761e-701a-4b27-99f4-16fa5dd96b1e" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-quobyte-8bc1761e-701a-4b27-99f4-16fa5dd96b1e" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af00c67-c586-4d99-b75b-5ece8adaf318]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:11 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 1073741824" returned: 0 in 1.009s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:11 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 Jun 27 20:04:11 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:11 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e Jun 27 20:04:11 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:11 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf" returned: 0 in 0.690s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Lock "cinder-quobyte-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf" released by "delete_volume" :: held 1.500s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Created reservations ['0ce5b94a-1705-4d7c-ad2d-a63794ba495d', 'd6162b80-f146-4789-81b9-29bdbd9a1667', '701ff480-b687-40ac-8275-00fdaa11c37b', '8ffd09d1-d239-453c-934c-45dc209e62ee'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:12 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:12 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:12 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685" returned: 0 in 0.681s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.436s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1958931275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=defe514a-af16-4406-b358-58425de18998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f96cd2b4faa4f24a4a90fdc48b5a932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:03Z,use_quota=True,user_id='a3723a5c9eae4b10b2b58b7ab5b5aca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(892af9f7-1e7c-4607-99be-f24486b0fe45),volume_type_id=892af9f7-1e7c-4607-99be-f24486b0fe45)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Creating volume defe514a-af16-4406-b358-58425de18998 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:12 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fb8996-c024-49d1-9d1c-894793fb0bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d3e329-a602-41f1-ba84-160ac0c97685', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2735538b-9980-4245-b5a6-d134dab19ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:12 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 1073741824 Jun 27 20:04:12 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:12 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e" returned: 0 in 0.788s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:12 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Volume volume-73d3e329-a602-41f1-ba84-160ac0c97685 (73d3e329-a602-41f1-ba84-160ac0c97685): created successfully Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2735538b-9980-4245-b5a6-d134dab19ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:12 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e Jun 27 20:04:12 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Flow 'volume_create_manager' (06dfa2be-7b83-4e6f-942c-3e74bef3f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dcf96390-f3d3-4189-8cd2-2575b6f34f52 tempest-VolumesListAdminTestJSON-1046995770 None] Created volume successfully. Jun 27 20:04:12 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.788s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Deleted volume successfully. Jun 27 20:04:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0ec9945a-82af-4e83-8d22-4d1ba4de7182 tempest-VolumesMetadataTest-812945162 None] Lock "cinder-f0dfcbe5-4f34-4562-94b7-92cd2d50c2cf-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:13 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8bc1761e-701a-4b27-99f4-16fa5dd96b1e" returned: 0 in 0.768s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-quobyte-8bc1761e-701a-4b27-99f4-16fa5dd96b1e" released by "delete_volume" :: held 1.601s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Created reservations ['d4b1471b-0322-4cf7-a1ea-8713d5af5764', '53808b13-f081-45b1-88ad-85fa28fb2d79', 'c56d08e3-1165-414c-8b51-f955e3f6eb8c', '2ae73abb-667d-410c-b5a9-2a2796048913'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:13 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:13 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:13 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 1073741824" returned: 0 in 1.122s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:13 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:04:13 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Flow 'volume_create_manager' (8ca352f4-3496-44d9-a032-464446b6e18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ace9ad-cfc0-481a-a8fe-a1637a5fa513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ace9ad-cfc0-481a-a8fe-a1637a5fa513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-329750117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a69ee9-aee3-4571-8cb4-d004e09432e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4028d221ec3443a593fd92285bacae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:14Z,use_quota=True,user_id='a3b06ed9e9924ce38399e134f9908863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b540a4bf-2e5e-41d4-8f60-a00251a7306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b540a4bf-2e5e-41d4-8f60-a00251a7306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b962fb-c7da-47cd-b061-abe4c5271524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b962fb-c7da-47cd-b061-abe4c5271524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a69ee9-aee3-4571-8cb4-d004e09432e8', 'volume_name': 'volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7a3ff6-1280-4b21-ad01-9f6dce0395e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7a3ff6-1280-4b21-ad01-9f6dce0395e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:14 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647364d4-c97a-4443-838a-0b53444b90ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:14 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Volume e4a69ee9-aee3-4571-8cb4-d004e09432e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8', 'volume_size': 1} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.887s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:14 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Deleted volume successfully. Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa6830a1-9b60-453a-bb18-3dd38939729a tempest-VolumesTransfersV357Test-1794292265 None] Lock "cinder-8bc1761e-701a-4b27-99f4-16fa5dd96b1e-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:14 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 0 in 0.992s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-329750117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a69ee9-aee3-4571-8cb4-d004e09432e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4028d221ec3443a593fd92285bacae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:14Z,use_quota=True,user_id='a3b06ed9e9924ce38399e134f9908863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Creating volume e4a69ee9-aee3-4571-8cb4-d004e09432e8 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:14 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:14 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 1073741824 Jun 27 20:04:14 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Attempting download of 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'metadata': {}}])) to volume defe514a-af16-4406-b358-58425de18998. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e0a34-2de5-40aa-a3eb-75ffd05d7e3f]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:14 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56 Jun 27 20:04:14 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:15 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 1073741824" returned: 0 in 1.000s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:15 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 Jun 27 20:04:15 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:15 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56" returned: 0 in 0.983s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:15 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56 Jun 27 20:04:15 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:16 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:16 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:16 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8" returned: 0 in 0.996s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647364d4-c97a-4443-838a-0b53444b90ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2ff756-ddb5-46b7-9384-a4759683b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:16 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56" returned: 1 in 1.008s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rifc1e56' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f4ab9-887e-45f6-99e2-00937039d3ba]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:16 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Volume volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 (e4a69ee9-aee3-4571-8cb4-d004e09432e8): created successfully Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2ff756-ddb5-46b7-9384-a4759683b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Flow 'volume_create_manager' (8ca352f4-3496-44d9-a032-464446b6e18a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:16 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-49b423c5-49fd-49ef-88b1-af4825f499e4 tempest-VolumesListAdminTestJSON-1046995770 None] Created volume successfully. Jun 27 20:04:16 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD Jun 27 20:04:16 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:17 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.968s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:04:17 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD" returned: 0 in 1.066s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 was qcow2, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:04:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:17 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:04:17 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Flow 'volume_create_manager' (7e78a5e4-a3c8-4d0b-aa25-a3039472a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c25e85-b86c-4cfe-ad76-4486e94ca553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c25e85-b86c-4cfe-ad76-4486e94ca553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f668e3c0-fc41-411d-b6a1-edf41e768ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d64e0bd79ae4551b0ae88f1574708c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:18Z,use_quota=True,user_id='fdf2b73eb461486faea9acefb1325eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531a10d8-025a-406e-b679-253e910203ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531a10d8-025a-406e-b679-253e910203ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8138da9d-d2fc-49aa-a621-6dab3508aaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8138da9d-d2fc-49aa-a621-6dab3508aaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f668e3c0-fc41-411d-b6a1-edf41e768ef1', 'volume_name': 'volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5f27bd-ca6e-4495-8696-faf49ffd9d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5f27bd-ca6e-4495-8696-faf49ffd9d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1f8128-873c-4d4e-8600-54b6e9d5d787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:18 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Volume f668e3c0-fc41-411d-b6a1-edf41e768ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1', 'volume_size': 1} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f668e3c0-fc41-411d-b6a1-edf41e768ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d64e0bd79ae4551b0ae88f1574708c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:18Z,use_quota=True,user_id='fdf2b73eb461486faea9acefb1325eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Creating volume f668e3c0-fc41-411d-b6a1-edf41e768ef1 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:18 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:18 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 1073741824 Jun 27 20:04:18 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:19 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 1073741824" returned: 0 in 1.183s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:19 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 Jun 27 20:04:19 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:20 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 0 in 2.526s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4aab0baf-8e98-440c-bc2a-7b1cf63823d6_rn_jkgxodevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:04:20 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Converted 112.00 MB image at 44.31 MB/s Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:20 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 1G Jun 27 20:04:20 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:20 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1" returned: 0 in 0.912s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1f8128-873c-4d4e-8600-54b6e9d5d787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69eaf69-f111-4dec-82e4-09ef7452dc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:20 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Volume volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 (f668e3c0-fc41-411d-b6a1-edf41e768ef1): created successfully Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69eaf69-f111-4dec-82e4-09ef7452dc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Flow 'volume_create_manager' (7e78a5e4-a3c8-4d0b-aa25-a3039472a858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-eb260575-5520-4bd3-b673-890d7d7d6acb tempest-VolumesListAdminTestJSON-1524340856 None] Created volume successfully. Jun 27 20:04:21 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 1G" returned: 0 in 0.914s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bc5144-7cb7-43d4-b085-36ccd86bef5a]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:21 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:04:21 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Flow 'volume_create_manager' (24fdd164-c93c-4de3-b51b-cee04fd9b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a012120-57a3-4a19-8326-935acaaa4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a012120-57a3-4a19-8326-935acaaa4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-110840354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd303a1f-f246-4160-8531-328f83bbcf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b336f932f064211a21430c50f0151d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:21Z,use_quota=True,user_id='ccf771eba65342fcb22a7661cbca89fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a93f988-81ac-4ba5-b3f5-c1f57312e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a93f988-81ac-4ba5-b3f5-c1f57312e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4a078d-b8e5-4abe-937c-b7a35790e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4a078d-b8e5-4abe-937c-b7a35790e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd303a1f-f246-4160-8531-328f83bbcf96', 'volume_name': 'volume-bd303a1f-f246-4160-8531-328f83bbcf96', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8071d10-5541-49ab-804b-bde47a641c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8071d10-5541-49ab-804b-bde47a641c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6012f547-7d70-4c20-93d2-db623bbfa317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:21 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Volume bd303a1f-f246-4160-8531-328f83bbcf96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd303a1f-f246-4160-8531-328f83bbcf96', 'volume_size': 1} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-110840354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd303a1f-f246-4160-8531-328f83bbcf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b336f932f064211a21430c50f0151d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:21Z,use_quota=True,user_id='ccf771eba65342fcb22a7661cbca89fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Creating volume bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:21 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:21 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 1073741824 Jun 27 20:04:21 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Acquiring lock "cinder-f668e3c0-fc41-411d-b6a1-edf41e768ef1-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Lock "cinder-f668e3c0-fc41-411d-b6a1-edf41e768ef1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Acquiring lock "cinder-quobyte-f668e3c0-fc41-411d-b6a1-edf41e768ef1" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Lock "cinder-quobyte-f668e3c0-fc41-411d-b6a1-edf41e768ef1" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971b57c-d6a4-404b-9f2b-99136e44716d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "cinder-e4a69ee9-aee3-4571-8cb4-d004e09432e8-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-e4a69ee9-aee3-4571-8cb4-d004e09432e8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "cinder-quobyte-e4a69ee9-aee3-4571-8cb4-d004e09432e8" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:22 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 Jun 27 20:04:22 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-quobyte-e4a69ee9-aee3-4571-8cb4-d004e09432e8" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[025ccc79-6f4b-49ce-bcf4-a838affea0b4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:22 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 Jun 27 20:04:22 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:22 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 0 in 1.283s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:22 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:04:22 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:22 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 1073741824" returned: 0 in 1.306s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:22 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:22 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:23 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8" returned: 0 in 0.924s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:23 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:23 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8 Jun 27 20:04:23 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1" returned: 0 in 1.379s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:23 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1 Jun 27 20:04:23 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:23 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 1 in 1.227s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Downloaded image 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'metadata': {}}])) to volume defe514a-af16-4406-b358-58425de18998 successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Temporary image 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 for user a3723a5c9eae4b10b2b58b7ab5b5aca3 is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Marking volume defe514a-af16-4406-b358-58425de18998 as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=88,cinder:INSERT=40,cinder:UPDATE=125,cinder:DELETE=10 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Copying metadata from image 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 to defe514a-af16-4406-b358-58425de18998. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Creating volume glance metadata for volume defe514a-af16-4406-b358-58425de18998 backed by image 4aab0baf-8e98-440c-bc2a-7b1cf63823d6 with: {'image_id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'image_name': 'tempest-scenario-img--728242213', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:DELETE=14,cinder:UPDATE=124,cinder:SELECT=99,cinder:INSERT=30 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1488d0-188f-4c88-850a-d34d4bd4ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-defe514a-af16-4406-b358-58425de18998', 'volume_size': 1, 'image_id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--728242213', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f96cd2b4faa4f24a4a90fdc48b5a932', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4aab0baf-8e98-440c-bc2a-7b1cf63823d6', 'created_at': datetime.datetime(2026, 6, 27, 18, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aab0baf-8e98-440c-bc2a-7b1cf63823d6/file', 'properties': {}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98e64dc-1522-4b0b-baec-3fe3cfbeaa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:23 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Volume volume-defe514a-af16-4406-b358-58425de18998 (defe514a-af16-4406-b358-58425de18998): created successfully Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98e64dc-1522-4b0b-baec-3fe3cfbeaa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Flow 'volume_create_manager' (107cfd35-86a4-4ff4-9b59-c980b2d9535e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-38a1c22d-0e6a-442f-9b0b-38f0b271fde0 tempest-TestInstancesWithCinderVolumes-829353016 None] Created volume successfully. Jun 27 20:04:23 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 1.064s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6012f547-7d70-4c20-93d2-db623bbfa317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd303a1f-f246-4160-8531-328f83bbcf96', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d9b0c-57da-41e5-8ae9-dd63f4cc70f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:23 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Volume volume-bd303a1f-f246-4160-8531-328f83bbcf96 (bd303a1f-f246-4160-8531-328f83bbcf96): created successfully Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d9b0c-57da-41e5-8ae9-dd63f4cc70f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Flow 'volume_create_manager' (24fdd164-c93c-4de3-b51b-cee04fd9b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-865ee408-f70d-4a73-8a30-35909315f905 tempest-VolumesCloneTest-1376791343 None] Created volume successfully. Jun 27 20:04:24 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e4a69ee9-aee3-4571-8cb4-d004e09432e8" returned: 0 in 0.845s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-quobyte-e4a69ee9-aee3-4571-8cb4-d004e09432e8" released by "delete_volume" :: held 1.834s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Created reservations ['3ab236df-e832-469d-a6b3-89ec48ad2467', '20d5b78c-f967-4f01-8aa1-6752c637aff6', 'd1c44ed5-803a-417f-af7e-3bff2e39db63', '06850d12-69de-42e4-ad4a-3997969ee70e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:24 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:24 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:24 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f668e3c0-fc41-411d-b6a1-edf41e768ef1" returned: 0 in 0.972s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Lock "cinder-quobyte-f668e3c0-fc41-411d-b6a1-edf41e768ef1" released by "delete_volume" :: held 2.461s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Created reservations ['52dd1b18-7feb-4a48-be28-915559c0b28b', '38ae404b-72db-4882-963b-82715c25348a', '2d18bdd3-30f9-48c3-b36f-953094d44feb', '8ba0e0e0-6fd9-4fef-8f47-557be2e1f2f1'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:24 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:24 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "cinder-73d3e329-a602-41f1-ba84-160ac0c97685-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-73d3e329-a602-41f1-ba84-160ac0c97685-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "cinder-quobyte-73d3e329-a602-41f1-ba84-160ac0c97685" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-quobyte-73d3e329-a602-41f1-ba84-160ac0c97685" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56e6556-0aa9-45e3-8e0e-647a67b873fe]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:24 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 Jun 27 20:04:24 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:25 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.959s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Deleted volume successfully. Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d67e5a30-27eb-4875-805a-73ccea266b30 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-e4a69ee9-aee3-4571-8cb4-d004e09432e8-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:25 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.320s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Deleted volume successfully. Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-53b1baf6-f57f-4698-960c-a85e55ee5ed6 tempest-VolumesListAdminTestJSON-1524340856 None] Lock "cinder-f668e3c0-fc41-411d-b6a1-edf41e768ef1-delete_volume" released by "delete_volume" :: held 4.126s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Flow 'volume_create_manager' (2f798b59-8bfb-4870-a4e5-763113abcfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e70965-a08b-412c-aff4-0b6d3c813563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e70965-a08b-412c-aff4-0b6d3c813563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-511279074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f89d3a-3fbc-4891-ab7c-e10c36527c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b336f932f064211a21430c50f0151d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bd303a1f-f246-4160-8531-328f83bbcf96,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:26Z,use_quota=True,user_id='ccf771eba65342fcb22a7661cbca89fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e0f113-52e4-4751-88ee-ee3ae2fd8df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e0f113-52e4-4751-88ee-ee3ae2fd8df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f933024-ce3f-46dc-8e95-c03b2b8c0473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f933024-ce3f-46dc-8e95-c03b2b8c0473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b4f89d3a-3fbc-4891-ab7c-e10c36527c10', 'volume_name': 'volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10', 'volume_size': 2, 'source_volid': 'bd303a1f-f246-4160-8531-328f83bbcf96', 'source_volstatus': 'available'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12aa163-3699-40ae-b3b7-35412255623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12aa163-3699-40ae-b3b7-35412255623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9032be81-5304-49bb-bd43-2144ab596a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:26 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Volume b4f89d3a-3fbc-4891-ab7c-e10c36527c10: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10', 'volume_size': 2, 'source_volid': 'bd303a1f-f246-4160-8531-328f83bbcf96', 'source_volstatus': 'available'} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:26 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Cloning volume bd303a1f-f246-4160-8531-328f83bbcf96 to volume b4f89d3a-3fbc-4891-ab7c-e10c36527c10 Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Creating offline snapshot 5834fe57-9f75-4761-b051-cad501fab504 of volume bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:04:26 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685" returned: 0 in 1.445s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac59f00-5344-4dfe-8cf4-b76e682732ff]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:26 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685 Jun 27 20:04:26 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:26 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:26 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:27 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-73d3e329-a602-41f1-ba84-160ac0c97685" returned: 0 in 0.937s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-quobyte-73d3e329-a602-41f1-ba84-160ac0c97685" released by "delete_volume" :: held 2.470s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:27 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 1.027s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Created reservations ['3fff36d2-b648-49d4-b284-d4f5295b7f6f', '68823e3d-148f-46ea-b519-c86d2e65f2ae', 'c840987f-80c8-4816-836e-1e7ee80ed633', 'c34e7636-8a94-4936-8914-9e71d007ef04'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:27 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 1G Jun 27 20:04:27 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:27 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:27 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:28 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.831s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "cinder-d16e9878-c576-40eb-b4cc-3e6a34e3ee13-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Deleted volume successfully. Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-d16e9878-c576-40eb-b4cc-3e6a34e3ee13-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aefb9651-5bf7-4d20-83ac-73caf053e1b9 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-73d3e329-a602-41f1-ba84-160ac0c97685-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:28 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "cinder-quobyte-d16e9878-c576-40eb-b4cc-3e6a34e3ee13" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 1G" returned: 0 in 1.097s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd303a1f-f246-4160-8531-328f83bbcf96 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-quobyte-d16e9878-c576-40eb-b4cc-3e6a34e3ee13" acquired by "delete_volume" :: waited 0.058s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:28 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd303a1f-f246-4160-8531-328f83bbcf96 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 Jun 27 20:04:28 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c6544f-e44d-49f0-b589-12efe62c6ce5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:28 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 Jun 27 20:04:28 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:29 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd303a1f-f246-4160-8531-328f83bbcf96 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504" returned: 0 in 0.930s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:29 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 is being set with open permissions: ugo+rw Jun 27 20:04:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:29 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 Jun 27 20:04:29 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:29 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13" returned: 0 in 0.990s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:29 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13 Jun 27 20:04:29 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:30 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504" returned: 0 in 0.938s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:30 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-d16e9878-c576-40eb-b4cc-3e6a34e3ee13" returned: 0 in 0.914s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:30 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info Jun 27 20:04:30 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-quobyte-d16e9878-c576-40eb-b4cc-3e6a34e3ee13" released by "delete_volume" :: held 1.953s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Created reservations ['0165aa8a-3226-4f20-a5b5-654e0146fbe4', '39d9df8c-02a6-4fbe-8529-777a0ec3b64c', '84503542-c8eb-44a0-acf5-845f8885546e', '27d873ca-a020-42d6-929f-4aba5c50b96e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:30 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:30 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:31 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info" returned: 0 in 0.873s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:31 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info is being set with open permissions: ugo+rw Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:31 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info Jun 27 20:04:31 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:31 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.821s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Deleted volume successfully. Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e3e1ec2c-fa7e-4baa-b5d4-1edbf8a8a105 tempest-VolumesListAdminTestJSON-1046995770 None] Lock "cinder-d16e9878-c576-40eb-b4cc-3e6a34e3ee13-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Flow 'volume_create_manager' (165208a7-bdcf-4814-a22e-3ba9d7c1e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db78101-2170-4221-b9fc-f4d62de827ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db78101-2170-4221-b9fc-f4d62de827ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-86557171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4585c3c-d3e9-4338-9220-b43b72fea5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02328e13cd664b819112329ac414a9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:31Z,use_quota=True,user_id='d67142b4fe6d487fac95cee308a64c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acda1fb3-da23-4e2c-9022-81333e5c7ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acda1fb3-da23-4e2c-9022-81333e5c7ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bf8b75-606a-48fb-88c9-64b4952436c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bf8b75-606a-48fb-88c9-64b4952436c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4585c3c-d3e9-4338-9220-b43b72fea5ff', 'volume_name': 'volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b311496-cb45-42e6-9c29-756b17d3ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b311496-cb45-42e6-9c29-756b17d3ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a40f5d-46ed-45c7-934a-e2dc5fd14751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:31 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Volume b4585c3c-d3e9-4338-9220-b43b72fea5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff', 'volume_size': 1} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:31 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.info" returned: 0 in 0.772s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "cinder-quobyte-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] snapshot: 5834fe57-9f75-4761-b051-cad501fab504, volume: b4f89d3a-3fbc-4891-ab7c-e10c36527c10, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb88f79-16ae-43c8-9155-9ab23054faca]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:32 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 Jun 27 20:04:32 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:32 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504" returned: 0 in 0.868s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd303a1f-f246-4160-8531-328f83bbcf96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:04:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:04:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:04:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a25516-0b13-481e-9ea1-4a7b683b4168]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:33 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:33 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:33 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 0.983s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:33 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:04:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:33 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 Jun 27 20:04:33 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:39 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" returned: 0 in 6.048s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[53571beb-876e-4186-832b-5b03fac3c920]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:40 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:40 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:40 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 1.051s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:40 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:04:40 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Converted 1024.00 MB image at 169.28 MB/s Jun 27 20:04:40 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 is being set with open permissions: ugo+rw Jun 27 20:04:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:41 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 Jun 27 20:04:41 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Flow 'volume_create_manager' (03d886cf-8339-48b6-b54e-4e598d5ff748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e03f28-0f2a-4997-9fed-6e2f834b3677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e03f28-0f2a-4997-9fed-6e2f834b3677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1830040534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136ea9a7-3545-4dc7-b941-0b9d42c3c0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c4f65070114e45827e03272905bb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:41Z,use_quota=True,user_id='1b8d8cc2598b400892d34343734f9963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cd925f-1bd0-4679-a2df-1a13dc429db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cd925f-1bd0-4679-a2df-1a13dc429db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2f4ed1-4c86-4b97-9ed5-d0a0600a4170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2f4ed1-4c86-4b97-9ed5-d0a0600a4170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136ea9a7-3545-4dc7-b941-0b9d42c3c0ed', 'volume_name': 'volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ecd5d1-43c9-423d-8a7e-f60e912dde7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ecd5d1-43c9-423d-8a7e-f60e912dde7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d199cec9-b326-4872-bcb8-c07a5fcc5a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:41 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Volume 136ea9a7-3545-4dc7-b941-0b9d42c3c0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed', 'volume_size': 1} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:41 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" returned: 0 in 0.668s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" released by "_copy_volume_from_snapshot" :: held 9.717s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "cinder-quobyte-5834fe57-9f75-4761-b051-cad501fab504" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-5834fe57-9f75-4761-b051-cad501fab504" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Deleting offline snapshot 5834fe57-9f75-4761-b051-cad501fab504 of volume bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] snapshot_file for this snap is: volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c27fc-7c7e-4679-8822-20cadd568630]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:41 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 Jun 27 20:04:41 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:42 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504" returned: 0 in 0.749s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd303a1f-f246-4160-8531-328f83bbcf96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:04:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda6f88-99ad-4ddb-842c-33b8da318c0c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:43 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 0.753s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:43 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 Jun 27 20:04:43 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:43 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504" returned: 0 in 0.712s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:43 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504 Jun 27 20:04:43 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:44 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96.5834fe57-9f75-4761-b051-cad501fab504" returned: 0 in 0.639s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-5834fe57-9f75-4761-b051-cad501fab504" released by "_delete_snapshot" :: held 2.936s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.531s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.093s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-86557171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4585c3c-d3e9-4338-9220-b43b72fea5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02328e13cd664b819112329ac414a9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:31Z,use_quota=True,user_id='d67142b4fe6d487fac95cee308a64c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Creating volume b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:44 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9032be81-5304-49bb-bd43-2144ab596a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10', 'volume_size': 2, 'source_volid': 'bd303a1f-f246-4160-8531-328f83bbcf96', 'source_volstatus': 'available'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:44 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff 1073741824 Jun 27 20:04:44 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b31c736-d58f-4a21-b303-df8ee0f07fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:44 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Volume volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 (b4f89d3a-3fbc-4891-ab7c-e10c36527c10): created successfully Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b31c736-d58f-4a21-b303-df8ee0f07fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Flow 'volume_create_manager' (2f798b59-8bfb-4870-a4e5-763113abcfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-74c836a8-0b19-4035-be67-a5497c074b93 tempest-VolumesCloneTest-1376791343 None] Created volume successfully. Jun 27 20:04:45 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff 1073741824" returned: 0 in 0.806s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:45 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:04:45 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "cinder-b4f89d3a-3fbc-4891-ab7c-e10c36527c10-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-b4f89d3a-3fbc-4891-ab7c-e10c36527c10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "cinder-quobyte-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[50346d0a-7ce5-45cc-af4c-b6fb04d884f2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:46 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 Jun 27 20:04:46 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:46 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 0.707s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.891s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a40f5d-46ed-45c7-934a-e2dc5fd14751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded85630-a9f1-496b-bfc1-b17f09c81e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:46 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Volume volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff (b4585c3c-d3e9-4338-9220-b43b72fea5ff): created successfully Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded85630-a9f1-496b-bfc1-b17f09c81e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Flow 'volume_create_manager' (165208a7-bdcf-4814-a22e-3ba9d7c1e829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75e9ba6-1d12-4433-95ec-714d102348f9]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:46 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f476f2b9-dc7b-4402-8412-770fe8a7ebee tempest-VolumesActionsTest-73872825 None] Created volume successfully. Jun 27 20:04:46 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:04:46 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:46 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" returned: 0 in 0.752s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:46 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10 Jun 27 20:04:46 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:47 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 0 in 0.831s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:47 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:04:47 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:47 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" returned: 0 in 0.707s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-b4f89d3a-3fbc-4891-ab7c-e10c36527c10" released by "delete_volume" :: held 1.512s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Created reservations ['c8e991f7-1221-4aca-917b-29c2749ceef0', '81efa441-3245-461d-a3e8-bb13a61d8843', 'dbf4c3e2-b6bc-49dc-8b25-34f51e333de0', '66c513d5-f49c-4daa-89bf-278e8d1127d8'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:47 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:47 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:47 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 1 in 0.854s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.749s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.406s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1830040534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136ea9a7-3545-4dc7-b941-0b9d42c3c0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c4f65070114e45827e03272905bb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:04:41Z,use_quota=True,user_id='1b8d8cc2598b400892d34343734f9963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Creating volume 136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:47 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:48 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed 1073741824 Jun 27 20:04:48 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-defe514a-af16-4406-b358-58425de18998', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f3c841f-1bcd-4c24-b039-898b69992e11', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:04:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-bed40002-d3dc-47e5-b6eb-aca51e7555ec req-91c7f85d-5628-4071-af89-5d396c2810c8 tempest-TestInstancesWithCinderVolumes-829353016 None] attachment_update completed successfully. Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "cinder-bd303a1f-f246-4160-8531-328f83bbcf96-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-bd303a1f-f246-4160-8531-328f83bbcf96-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "cinder-quobyte-bd303a1f-f246-4160-8531-328f83bbcf96" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:04:48 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.878s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Deleted volume successfully. Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-bd303a1f-f246-4160-8531-328f83bbcf96" acquired by "delete_volume" :: waited 0.031s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c3af55-3855-4247-85e3-3ecd4fd5970c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d7e93071-a47a-42b5-b2ad-15a1cbc51ba3 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-b4f89d3a-3fbc-4891-ab7c-e10c36527c10-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:48 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:48 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:49 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed 1073741824" returned: 0 in 1.161s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:49 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed Jun 27 20:04:49 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:49 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 0.874s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:49 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96 Jun 27 20:04:49 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:49 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" returned: 0 in 0.771s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d199cec9-b326-4872-bcb8-c07a5fcc5a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352598d5-52fb-499f-b9f1-542d94e80192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:50 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Volume volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed (136ea9a7-3545-4dc7-b941-0b9d42c3c0ed): created successfully Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352598d5-52fb-499f-b9f1-542d94e80192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Flow 'volume_create_manager' (03d886cf-8339-48b6-b54e-4e598d5ff748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-551dade0-04b0-4808-98ae-7758523052bb tempest-SnapshotMetadataTestJSON-988007937 None] Created volume successfully. Jun 27 20:04:50 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bd303a1f-f246-4160-8531-328f83bbcf96" returned: 0 in 0.766s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-quobyte-bd303a1f-f246-4160-8531-328f83bbcf96" released by "delete_volume" :: held 1.725s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Created reservations ['58ffbc81-0ccf-4926-92a2-64c6af728203', 'd319f8e6-9c35-44f2-90fd-8d4f50d67e38', 'db002f8e-9cf3-4f68-acb9-2952864b7a9c', 'd254beb3-15fd-426c-bccc-fc3afa613703'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:50 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:04:50 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:50 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.683s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:04:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Deleted volume successfully. Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-40bc21d2-0eca-4cb7-bd37-adf633642b76 tempest-VolumesCloneTest-1376791343 None] Lock "cinder-bd303a1f-f246-4160-8531-328f83bbcf96-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Creating offline snapshot af6ffda8-76f8-4880-8b41-b93656d6865c of volume 136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7a52df-cb81-4c12-8a64-6169016485f1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:04:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:51 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed Jun 27 20:04:51 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:52 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:52 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c 1G Jun 27 20:04:52 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:53 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c 1G" returned: 0 in 1.011s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:53 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c Jun 27 20:04:53 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:54 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c" returned: 0 in 1.259s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:54 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c is being set with open permissions: ugo+rw Jun 27 20:04:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:54 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c Jun 27 20:04:54 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:55 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c" returned: 0 in 1.396s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:56 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info Jun 27 20:04:56 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:57 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info" returned: 0 in 1.049s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:57 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info is being set with open permissions: ugo+rw Jun 27 20:04:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:57 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info Jun 27 20:04:57 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:04:58 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jun 27 20:04:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.info" returned: 0 in 1.205s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:04:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.921s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-25a7b659-33c8-4e43-b146-19ba36598a82 tempest-SnapshotMetadataTestJSON-988007937 None] Create snapshot completed successfully Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Flow 'volume_create_manager' (887dc6f2-9872-4543-90c1-63a6130f9962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cc03a4-6d7b-467a-a200-a5a88328fc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cc03a4-6d7b-467a-a200-a5a88328fc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1793272070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f63daa-cd0c-4729-b4ff-319b468a573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d249f2710c746e2ab2c113cb12ef614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:00Z,use_quota=True,user_id='5657816565c24c33bcab4a00996e14b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d8db76-2001-47b4-9b51-5ce0f262d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d8db76-2001-47b4-9b51-5ce0f262d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39080454-251a-402e-ba31-30267dc5bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39080454-251a-402e-ba31-30267dc5bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f63daa-cd0c-4729-b4ff-319b468a573b', 'volume_name': 'volume-a8f63daa-cd0c-4729-b4ff-319b468a573b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d995b0ed-ee3d-430d-93bd-788a1af4a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d995b0ed-ee3d-430d-93bd-788a1af4a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6801bbb9-e767-4bb3-961b-bcf65ed26937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:04:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Volume a8f63daa-cd0c-4729-b4ff-319b468a573b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f63daa-cd0c-4729-b4ff-319b468a573b', 'volume_size': 1} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1793272070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f63daa-cd0c-4729-b4ff-319b468a573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d249f2710c746e2ab2c113cb12ef614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:00Z,use_quota=True,user_id='5657816565c24c33bcab4a00996e14b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Creating volume a8f63daa-cd0c-4729-b4ff-319b468a573b {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:04:59 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:04:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:04:59 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b 1073741824 Jun 27 20:04:59 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "cinder-af6ffda8-76f8-4880-8b41-b93656d6865c-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-af6ffda8-76f8-4880-8b41-b93656d6865c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "cinder-quobyte-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-quobyte-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "cinder-quobyte-af6ffda8-76f8-4880-8b41-b93656d6865c" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-quobyte-af6ffda8-76f8-4880-8b41-b93656d6865c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Deleting offline snapshot af6ffda8-76f8-4880-8b41-b93656d6865c of volume 136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] snapshot_file for this snap is: volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb543c2b-151b-4f9d-9687-198d4f5f5934]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:00 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c Jun 27 20:05:00 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:01 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b 1073741824" returned: 0 in 1.376s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:01 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b Jun 27 20:05:01 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:01 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c" returned: 0 in 1.505s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:05:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71737f-cbb9-42fd-9fe9-35b077aa01fc]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:02 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed Jun 27 20:05:02 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:02 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b" returned: 0 in 1.146s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] <== create_volume: return (2610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6801bbb9-e767-4bb3-961b-bcf65ed26937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f63daa-cd0c-4729-b4ff-319b468a573b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e80975b-5c61-437f-af25-c26a56140e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:02 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Volume volume-a8f63daa-cd0c-4729-b4ff-319b468a573b (a8f63daa-cd0c-4729-b4ff-319b468a573b): created successfully Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e80975b-5c61-437f-af25-c26a56140e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Flow 'volume_create_manager' (887dc6f2-9872-4543-90c1-63a6130f9962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5c3a3141-b440-42b1-980b-1d682072c41f tempest-VolumesNegativeTest-1772040390 None] Created volume successfully. Jun 27 20:05:03 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" returned: 0 in 1.360s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:03 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c Jun 27 20:05:03 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:05 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c" returned: 0 in 2.452s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:05 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c Jun 27 20:05:05 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:07 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed.af6ffda8-76f8-4880-8b41-b93656d6865c" returned: 0 in 1.355s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-quobyte-af6ffda8-76f8-4880-8b41-b93656d6865c" released by "_delete_snapshot" :: held 6.830s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-quobyte-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" released by "delete_snapshot" :: held 6.875s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:07 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Created reservations ['5f423dd9-a062-4359-a209-9587aebaa035', '80bacaf5-725b-47d0-a989-9e89fb6141f9', '60758c5b-e8c0-45bf-8f78-405a397a5b30', 'f40960c9-1fb4-4077-9239-9b5301c09328'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Delete snapshot completed successfully. Jun 27 20:05:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bbecc91-96b9-4fe7-99da-bf3bd1e2bab8 tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-af6ffda8-76f8-4880-8b41-b93656d6865c-delete_snapshot" released by "delete_snapshot" :: held 7.084s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "cinder-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "cinder-quobyte-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-quobyte-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0961f1-942a-4141-9174-b5d1f8d30408]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:08 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed Jun 27 20:05:08 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6ea0dcf8-526b-43e9-857a-c9e58e5fadc8 tempest-VolumesActionsTest-73872825 None] Acquiring lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff" by "attach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6ea0dcf8-526b-43e9-857a-c9e58e5fadc8 tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff" acquired by "attach_volume" :: waited 0.042s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6ea0dcf8-526b-43e9-857a-c9e58e5fadc8 tempest-VolumesActionsTest-73872825 None] Attaching volume b4585c3c-d3e9-4338-9220-b43b72fea5ff to instance 92531566-a93f-4a5d-bbe3-0fdd40ed74cc at mountpoint /dev/vdb on host None. Jun 27 20:05:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6ea0dcf8-526b-43e9-857a-c9e58e5fadc8 tempest-VolumesActionsTest-73872825 None] Attach volume completed successfully. Jun 27 20:05:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6ea0dcf8-526b-43e9-857a-c9e58e5fadc8 tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff" released by "attach_volume" :: held 0.176s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:09 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" returned: 0 in 1.153s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:09 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed Jun 27 20:05:09 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0bb6f824-7fad-43bd-88ab-685582d13729 tempest-VolumesActionsTest-73872825 None] Acquiring lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-detach_volume" by "detach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0bb6f824-7fad-43bd-88ab-685582d13729 tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0bb6f824-7fad-43bd-88ab-685582d13729 tempest-VolumesActionsTest-73872825 None] Detaching volume b4585c3c-d3e9-4338-9220-b43b72fea5ff from instance 92531566-a93f-4a5d-bbe3-0fdd40ed74cc. Jun 27 20:05:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0bb6f824-7fad-43bd-88ab-685582d13729 tempest-VolumesActionsTest-73872825 None] Detach volume completed successfully. Jun 27 20:05:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0bb6f824-7fad-43bd-88ab-685582d13729 tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-detach_volume" released by "detach_volume" :: held 0.188s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:11 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" returned: 0 in 1.504s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-quobyte-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed" released by "delete_volume" :: held 2.819s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Created reservations ['4c6f7a15-dcbd-414e-a6e3-bed4747912f1', 'c24e46a0-0ea1-49af-a715-1d90cc148767', '508d7a24-7d97-4039-a843-8fc862cd24fe', '6b05b338-d36d-4706-be66-4a0ab05f2d05'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:11 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:11 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:13 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.831s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:13 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:05:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Deleted volume successfully. Jun 27 20:05:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0995ce2f-7b7d-4d96-8172-b7fccdfe42bf tempest-SnapshotMetadataTestJSON-988007937 None] Lock "cinder-136ea9a7-3545-4dc7-b941-0b9d42c3c0ed-delete_volume" released by "delete_volume" :: held 5.209s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:16 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:16 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:16 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.703s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:05:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Flow 'volume_create_manager' (0318736d-5b21-463e-9efb-e73b665fb85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdbf02-1841-4dd0-ad36-cc4b4aca3932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdbf02-1841-4dd0-ad36-cc4b4aca3932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-783843063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255f097f-06e7-41c2-bea9-0e223c0db15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b72c9df0c72418aa996b2005add4d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:17Z,use_quota=True,user_id='7ad38939d4884ab3a75589e94c9dba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba749d82-2557-477d-bbd0-4e4f2d44f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba749d82-2557-477d-bbd0-4e4f2d44f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf59ceb-4917-4b58-b0fa-eef56df796c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf59ceb-4917-4b58-b0fa-eef56df796c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255f097f-06e7-41c2-bea9-0e223c0db15e', 'volume_name': 'volume-255f097f-06e7-41c2-bea9-0e223c0db15e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7787af-0464-4ae6-be8b-d642c4fe3eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7787af-0464-4ae6-be8b-d642c4fe3eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419d05cd-3a45-4ad8-8cf2-bcc0323edb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:17 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Volume 255f097f-06e7-41c2-bea9-0e223c0db15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255f097f-06e7-41c2-bea9-0e223c0db15e', 'volume_size': 1} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-783843063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255f097f-06e7-41c2-bea9-0e223c0db15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b72c9df0c72418aa996b2005add4d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:17Z,use_quota=True,user_id='7ad38939d4884ab3a75589e94c9dba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Creating volume 255f097f-06e7-41c2-bea9-0e223c0db15e {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:05:17 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:05:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:17 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e 1073741824 Jun 27 20:05:17 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:18 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e 1073741824" returned: 0 in 0.854s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:18 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e Jun 27 20:05:18 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:18 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e" returned: 0 in 0.648s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419d05cd-3a45-4ad8-8cf2-bcc0323edb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255f097f-06e7-41c2-bea9-0e223c0db15e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb59fa2-0178-4e24-bd6e-ef0d8eaaff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:18 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Volume volume-255f097f-06e7-41c2-bea9-0e223c0db15e (255f097f-06e7-41c2-bea9-0e223c0db15e): created successfully Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb59fa2-0178-4e24-bd6e-ef0d8eaaff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Flow 'volume_create_manager' (0318736d-5b21-463e-9efb-e73b665fb85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-47de88b5-f3ab-4485-9314-fed41f494047 tempest-AbsoluteLimitsTests-1834195610 None] Created volume successfully. Jun 27 20:05:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Acquiring lock "cinder-255f097f-06e7-41c2-bea9-0e223c0db15e-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Lock "cinder-255f097f-06e7-41c2-bea9-0e223c0db15e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Acquiring lock "cinder-quobyte-255f097f-06e7-41c2-bea9-0e223c0db15e" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Lock "cinder-quobyte-255f097f-06e7-41c2-bea9-0e223c0db15e" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff01291-146d-4596-93b6-d45c6bbac2d0]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:19 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e Jun 27 20:05:19 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:20 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e" returned: 0 in 0.852s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:20 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e Jun 27 20:05:20 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:21 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-255f097f-06e7-41c2-bea9-0e223c0db15e" returned: 0 in 0.740s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Lock "cinder-quobyte-255f097f-06e7-41c2-bea9-0e223c0db15e" released by "delete_volume" :: held 1.640s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Created reservations ['8407ec77-66c9-4014-a9ca-1a7da6699ce5', '66a8cf30-1ec8-4d03-a388-9675a721564b', 'b0ac92ac-90b1-4b00-91c2-269cf872100c', '902f108c-3451-433e-9bb9-3c94f8cdbd75'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:21 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:21 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:23 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.660s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:23 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:05:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Deleted volume successfully. Jun 27 20:05:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-34b4f4bd-f65e-43f6-8e3b-429b6cd3d814 tempest-AbsoluteLimitsTests-1834195610 None] Lock "cinder-255f097f-06e7-41c2-bea9-0e223c0db15e-delete_volume" released by "delete_volume" :: held 3.565s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:INSERT=25,cinder:SELECT=71,cinder:UPDATE=84,cinder:DELETE=3 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=82,cinder:INSERT=29,cinder:UPDATE=105,cinder:DELETE=13 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Flow 'volume_create_manager' (66db9f92-3c8f-46f7-8261-9ad82e81cca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a4e27-49d7-4e6b-95a6-c207a20acf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a4e27-49d7-4e6b-95a6-c207a20acf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-464566501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bd6612-e08b-4b71-9f69-30374ecdbe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557d0b0e9f574018a9f03c76059f5c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:30Z,use_quota=True,user_id='8bad2639f0ea48d29164f5c722792dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12d26b6-db43-4e2a-9bc5-8a9f8d5d089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12d26b6-db43-4e2a-9bc5-8a9f8d5d089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ca56f-9d2e-4c14-9baa-af9aa318de2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ca56f-9d2e-4c14-9baa-af9aa318de2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bd6612-e08b-4b71-9f69-30374ecdbe7c', 'volume_name': 'volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8f7279-8986-4f37-9dcb-41f28880e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8f7279-8986-4f37-9dcb-41f28880e81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e702c4e9-1700-4a9e-9b8c-2cb7046d740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:29 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Volume 92bd6612-e08b-4b71-9f69-30374ecdbe7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c', 'volume_size': 1} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-464566501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bd6612-e08b-4b71-9f69-30374ecdbe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557d0b0e9f574018a9f03c76059f5c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:30Z,use_quota=True,user_id='8bad2639f0ea48d29164f5c722792dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Creating volume 92bd6612-e08b-4b71-9f69-30374ecdbe7c {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:05:30 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:05:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:30 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c 1073741824 Jun 27 20:05:30 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:30 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c 1073741824" returned: 0 in 0.955s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:31 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c Jun 27 20:05:31 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:31 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c" returned: 0 in 0.725s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e702c4e9-1700-4a9e-9b8c-2cb7046d740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9546c23-4b16-4f4f-ab01-604717c1a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:31 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Volume volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c (92bd6612-e08b-4b71-9f69-30374ecdbe7c): created successfully Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9546c23-4b16-4f4f-ab01-604717c1a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Flow 'volume_create_manager' (66db9f92-3c8f-46f7-8261-9ad82e81cca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8e75e514-76fd-43f3-8ae9-43d4058c4987 tempest-VolumesTransfersV355Test-1347583973 None] Created volume successfully. Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a45c3e9-6281-48e9-8362-6a12f221a5dc]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:32 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f Jun 27 20:05:32 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-79d87756-77af-4d56-ab5e-bddff03c4d0b tempest-VolumesTransfersV355Test-615873019 None] Transfer volume completed successfully. Jun 27 20:05:32 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" returned: 0 in 0.823s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e28a5ec5-ed9b-4d9b-85be-7c4406b66694', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:05:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-b848667a-efdb-440a-b500-a3201832eb98 req-7133bd11-8da8-4986-b316-c03434bbf7ab tempest-TestInstancesWithCinderVolumes-829353016 None] attachment_update completed successfully. Jun 27 20:05:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Acquiring lock "cinder-92bd6612-e08b-4b71-9f69-30374ecdbe7c-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-92bd6612-e08b-4b71-9f69-30374ecdbe7c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Acquiring lock "cinder-quobyte-92bd6612-e08b-4b71-9f69-30374ecdbe7c" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-quobyte-92bd6612-e08b-4b71-9f69-30374ecdbe7c" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609e4b5-3d25-4dec-a79c-aa3c546155b9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:34 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c Jun 27 20:05:34 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:35 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c" returned: 0 in 1.265s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:35 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c Jun 27 20:05:35 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:36 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92bd6612-e08b-4b71-9f69-30374ecdbe7c" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-quobyte-92bd6612-e08b-4b71-9f69-30374ecdbe7c" released by "delete_volume" :: held 2.123s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Created reservations ['28d7ce5f-a6a9-4787-b341-e9997b607194', 'c43318d1-39d0-4628-b079-f1280597eaf7', 'c12d57ec-656f-4438-b93d-7cc13eff0e56', '3258aa2a-bf42-4e94-8235-46eaee03bae2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:36 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:36 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:37 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.858s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:05:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Deleted volume successfully. Jun 27 20:05:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1cb92494-7efb-4e17-895c-7612f9e7d8f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-92bd6612-e08b-4b71-9f69-30374ecdbe7c-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:37 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Flow 'volume_create_manager' (26b5eee6-de24-4fd6-b803-a38be596de25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6659b2-b9b6-4363-9196-f31377a3f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6659b2-b9b6-4363-9196-f31377a3f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-908984912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da47ae31-067f-453e-9ed2-715934960545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557d0b0e9f574018a9f03c76059f5c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:38Z,use_quota=True,user_id='8bad2639f0ea48d29164f5c722792dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856cf477-c645-4bb4-9af0-dab1955a3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856cf477-c645-4bb4-9af0-dab1955a3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa309e8-b752-407c-aaf4-531859743c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa309e8-b752-407c-aaf4-531859743c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da47ae31-067f-453e-9ed2-715934960545', 'volume_name': 'volume-da47ae31-067f-453e-9ed2-715934960545', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eae9d5d-24de-4b58-b7db-a4233f1abd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eae9d5d-24de-4b58-b7db-a4233f1abd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df191a7-a725-486c-bd61-60d4c37beac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Volume da47ae31-067f-453e-9ed2-715934960545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da47ae31-067f-453e-9ed2-715934960545', 'volume_size': 1} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-908984912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da47ae31-067f-453e-9ed2-715934960545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557d0b0e9f574018a9f03c76059f5c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:38Z,use_quota=True,user_id='8bad2639f0ea48d29164f5c722792dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Creating volume da47ae31-067f-453e-9ed2-715934960545 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:05:38 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:38 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 1073741824 Jun 27 20:05:38 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-02a96fcc-40fe-4645-9e9b-c7b00b27a0ad tempest-VolumesActionsTest-73872825 None] Acquiring lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff" by "attach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-02a96fcc-40fe-4645-9e9b-c7b00b27a0ad tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff" acquired by "attach_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-02a96fcc-40fe-4645-9e9b-c7b00b27a0ad tempest-VolumesActionsTest-73872825 None] Attaching volume b4585c3c-d3e9-4338-9220-b43b72fea5ff to instance cb3f1f24-4e5e-4c7d-b391-4eb6fed42a09 at mountpoint /dev/vdb on host None. Jun 27 20:05:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-02a96fcc-40fe-4645-9e9b-c7b00b27a0ad tempest-VolumesActionsTest-73872825 None] Attach volume completed successfully. Jun 27 20:05:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-02a96fcc-40fe-4645-9e9b-c7b00b27a0ad tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff" released by "attach_volume" :: held 0.142s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1faecd80-fed1-44f7-acd0-a677c82c3e77 tempest-VolumesActionsTest-73872825 None] Acquiring lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-detach_volume" by "detach_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1faecd80-fed1-44f7-acd0-a677c82c3e77 tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1faecd80-fed1-44f7-acd0-a677c82c3e77 tempest-VolumesActionsTest-73872825 None] Detaching volume b4585c3c-d3e9-4338-9220-b43b72fea5ff from instance cb3f1f24-4e5e-4c7d-b391-4eb6fed42a09. Jun 27 20:05:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1faecd80-fed1-44f7-acd0-a677c82c3e77 tempest-VolumesActionsTest-73872825 None] Detach volume completed successfully. Jun 27 20:05:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1faecd80-fed1-44f7-acd0-a677c82c3e77 tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:39 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 1073741824" returned: 0 in 1.150s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:39 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 Jun 27 20:05:39 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:40 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545" returned: 0 in 0.870s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df191a7-a725-486c-bd61-60d4c37beac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da47ae31-067f-453e-9ed2-715934960545', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e69a6f-6544-40f9-b926-cbbf4c6eaae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:40 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Volume volume-da47ae31-067f-453e-9ed2-715934960545 (da47ae31-067f-453e-9ed2-715934960545): created successfully Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e69a6f-6544-40f9-b926-cbbf4c6eaae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Flow 'volume_create_manager' (26b5eee6-de24-4fd6-b803-a38be596de25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-02d63603-b903-4d8d-8140-d23ca4bcc26f tempest-VolumesTransfersV355Test-1347583973 None] Created volume successfully. Jun 27 20:05:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:41 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02dae42-9461-4339-a17b-d4957b856f99]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:41 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b Jun 27 20:05:41 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Acquiring lock "cinder-da47ae31-067f-453e-9ed2-715934960545-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-da47ae31-067f-453e-9ed2-715934960545-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Acquiring lock "cinder-quobyte-da47ae31-067f-453e-9ed2-715934960545" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-quobyte-da47ae31-067f-453e-9ed2-715934960545" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83123df2-d863-4ac1-9a59-0df3e82a5463]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:42 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 Jun 27 20:05:42 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Acquiring lock "cinder-a8f63daa-cd0c-4729-b4ff-319b468a573b-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Lock "cinder-a8f63daa-cd0c-4729-b4ff-319b468a573b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Acquiring lock "cinder-quobyte-a8f63daa-cd0c-4729-b4ff-319b468a573b" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Lock "cinder-quobyte-a8f63daa-cd0c-4729-b4ff-319b468a573b" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c6232-f00d-4f63-8927-b482a4478743]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:42 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b Jun 27 20:05:42 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:42 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" returned: 0 in 0.873s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b224b47b-3544-432d-a8ec-169a3b7a8b7c', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:05:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-f0a78819-45ac-45d9-a1a1-a3131b802542 req-8e9b4e78-b6b4-4f3d-bc8a-891537f9fcce tempest-TestInstancesWithCinderVolumes-829353016 None] attachment_update completed successfully. Jun 27 20:05:43 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545" returned: 0 in 0.976s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:43 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545 Jun 27 20:05:43 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:43 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b" returned: 0 in 0.956s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:43 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b Jun 27 20:05:43 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:43 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-da47ae31-067f-453e-9ed2-715934960545" returned: 0 in 0.682s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-quobyte-da47ae31-067f-453e-9ed2-715934960545" released by "delete_volume" :: held 1.714s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Created reservations ['7e2a0cfa-1d38-4870-b280-394facba6223', '4b748627-6e70-493a-aa6a-e09a8d8b79b7', '6fcb0218-6bf4-4d26-a6d2-89b8544538c2', 'b09627db-5f10-4176-82e7-c9a9856e80a5'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:43 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:43 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:44 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-a8f63daa-cd0c-4729-b4ff-319b468a573b" returned: 0 in 0.676s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Lock "cinder-quobyte-a8f63daa-cd0c-4729-b4ff-319b468a573b" released by "delete_volume" :: held 1.687s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Created reservations ['8a376ee1-d621-49df-9d74-3f0ea5b427f9', 'd157d223-18bb-49c7-b92e-4761669ee897', 'c6d58482-d809-4c24-9300-0fd839cefac5', '0af8052b-c2ee-4eca-98b4-8310023a37e9'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:44 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:44 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:44 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.870s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:05:44 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Deleted volume successfully. Jun 27 20:05:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-44922e12-bf36-4a3f-ad5e-74f867d915f3 tempest-VolumesTransfersV355Test-1818591435 None] Lock "cinder-da47ae31-067f-453e-9ed2-715934960545-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:45 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:45 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:05:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Deleted volume successfully. Jun 27 20:05:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b0ed120e-b886-434a-9266-c043336256dc tempest-VolumesNegativeTest-1772040390 None] Lock "cinder-a8f63daa-cd0c-4729-b4ff-319b468a573b-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3593d-d4a8-4b34-814a-e30cd81eef23]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:50 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:05:50 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:50 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 0.939s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:50 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aaefd3-65a5-48ba-a278-bd76b1d70f60]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:51 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:05:51 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:51 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 1.070s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.459abc81-f05f-40a2-9cac-21dd6524f8242amdbbjt.img {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:51 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.459abc81-f05f-40a2-9cac-21dd6524f8242amdbbjt.img Jun 27 20:05:51 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-d28d4f56-d39a-4276-869c-71ab9a5ed109 req-59aae753-af4e-4c4a-b7aa-3f95e45a97a1 tempest-TestInstancesWithCinderVolumes-829353016 None] Terminate volume connection completed successfully. Jun 27 20:05:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-d28d4f56-d39a-4276-869c-71ab9a5ed109 req-59aae753-af4e-4c4a-b7aa-3f95e45a97a1 tempest-TestInstancesWithCinderVolumes-829353016 None] Deleting attachment e28a5ec5-ed9b-4d9b-85be-7c4406b66694. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:05:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "cinder-3e9e6f09-9d45-498f-b8b3-c45c0dab589f-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-3e9e6f09-9d45-498f-b8b3-c45c0dab589f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "cinder-quobyte-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:05:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-quobyte-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:05:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[94727d7e-9f6d-4a3e-9e5c-ee6d2db8f7e7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:55 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f Jun 27 20:05:55 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:58 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" returned: 0 in 2.626s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:58 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f Jun 27 20:05:58 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:58 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.459abc81-f05f-40a2-9cac-21dd6524f8242amdbbjt.img" returned: 0 in 6.652s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cdc5a9-6a17-41f5-bf1b-68a66e97ffab]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:05:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:58 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:05:58 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:05:59 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Flow 'volume_create_manager' (c0b47887-8bd1-4b95-8b88-fc3c89d3581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f2dee0-ae5b-45d7-a175-778ee37e4bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" returned: 0 in 0.996s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f2dee0-ae5b-45d7-a175-778ee37e4bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bda8573-6f5a-466b-8ce2-397b3196a042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2e041085a44e2fbd72900c2aa2a292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:59Z,use_quota=True,user_id='fa9cd1f9dd8a4e65a7637b526a3e8dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce57a43-2ff3-4bc5-ac29-5dcc9c995e54),volume_type_id=2ce57a43-2ff3-4bc5-ac29-5dcc9c995e54)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0942a20-54a7-4079-8a20-16835b13d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0942a20-54a7-4079-8a20-16835b13d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a3b167-5f1a-4bf9-a597-3d15caff98e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-quobyte-3e9e6f09-9d45-498f-b8b3-c45c0dab589f" released by "delete_volume" :: held 3.812s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:05:59 devstack cinder-volume[93503]: WARNING cinder.quota [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-515751555-2122922256 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-515751555-2122922256, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:05:59 devstack cinder-volume[93503]: WARNING cinder.quota [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-515751555-2122922256 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-515751555-2122922256, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Created reservations ['eb943c61-a3bf-4245-b91b-10c2c74a5f7a', '3283e822-09f1-4ea7-a732-8638d68b183f', '5970c125-c060-4ed3-ad37-1e5f6277066f', '16d605d5-b1d7-4e4f-9b4e-f78a72afec40'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:05:59 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:05:59 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a3b167-5f1a-4bf9-a597-3d15caff98e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bda8573-6f5a-466b-8ce2-397b3196a042', 'volume_name': 'volume-5bda8573-6f5a-466b-8ce2-397b3196a042', 'volume_size': 1, 'image_id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21df739d748227743f95881249fc8a0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a2e041085a44e2fbd72900c2aa2a292', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bf06ac1dbeb7bbc8f95637666e9cffdc35845cc6d6d64b7d1ec138b55ba150336f106ef7300538970192794c94d6183695bc470b118ae9860da46005adec868', 'id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'created_at': datetime.datetime(2026, 6, 27, 18, 5, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 5, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e085a700-0b97-47a5-9db0-3fc8584c877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e085a700-0b97-47a5-9db0-3fc8584c877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4a3999-3667-4f67-91ef-3fd413cde69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:05:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Volume 5bda8573-6f5a-466b-8ce2-397b3196a042: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bda8573-6f5a-466b-8ce2-397b3196a042', 'volume_size': 1, 'image_id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21df739d748227743f95881249fc8a0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a2e041085a44e2fbd72900c2aa2a292', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bf06ac1dbeb7bbc8f95637666e9cffdc35845cc6d6d64b7d1ec138b55ba150336f106ef7300538970192794c94d6183695bc470b118ae9860da46005adec868', 'id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'created_at': datetime.datetime(2026, 6, 27, 18, 5, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 5, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 27 20:05:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Trying to clone 5bda8573-6f5a-466b-8ce2-397b3196a042 from image cf6a068b-72f1-4549-9c98-eb4be080f0f5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:06:00 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 1.398s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.459abc81-f05f-40a2-9cac-21dd6524f8242amdbbjt.img {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:06:00 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Converted 1024.00 MB image at 153.90 MB/s Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] 459abc81-f05f-40a2-9cac-21dd6524f824 was raw, no need to convert to raw {{(pid=93503) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:06:00 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Image download 0.00 MB at 0.00 MB/s Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dc6674-87df-4ec2-8eb6-ccfe821f3b4d]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:00 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD Jun 27 20:06:00 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:00 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.082s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:06:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Deleted volume successfully. Jun 27 20:06:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19b9e54a-5ca2-4ef7-b717-bc559cc0d501 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-3e9e6f09-9d45-498f-b8b3-c45c0dab589f-delete_volume" released by "delete_volume" :: held 5.247s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:01 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD" returned: 0 in 0.937s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:01 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD Jun 27 20:06:01 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-7f89c5a2-1504-4a5d-8f7b-8395341f0518 req-e8fe570d-166b-41e1-aa2b-2fb65406e690 tempest-TestInstancesWithCinderVolumes-829353016 None] Terminate volume connection completed successfully. Jun 27 20:06:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-7f89c5a2-1504-4a5d-8f7b-8395341f0518 req-e8fe570d-166b-41e1-aa2b-2fb65406e690 tempest-TestInstancesWithCinderVolumes-829353016 None] Deleting attachment b224b47b-3544-432d-a8ec-169a3b7a8b7c. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:06:02 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD" returned: 1 in 1.131s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:02 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Temporary image cf6a068b-72f1-4549-9c98-eb4be080f0f5 is fetched for user fa9cd1f9dd8a4e65a7637b526a3e8dfe. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:06:02 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8516e-4b71-4b9c-8ff5-e55587130dbe]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:02 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD Jun 27 20:06:02 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:03 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD" returned: 0 in 1.107s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:03 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD Jun 27 20:06:03 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "cinder-e32fe07a-8a0e-4d51-a127-d54b47a3d70b-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-e32fe07a-8a0e-4d51-a127-d54b47a3d70b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "cinder-quobyte-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-quobyte-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad675df-0c0c-4845-9132-ffe12198f41a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:04 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b Jun 27 20:06:04 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:04 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD" returned: 1 in 1.097s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:05 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" returned: 0 in 1.174s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:05 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b Jun 27 20:06:05 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:06 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" returned: 0 in 1.122s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-quobyte-e32fe07a-8a0e-4d51-a127-d54b47a3d70b" released by "delete_volume" :: held 2.382s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:06 devstack cinder-volume[93503]: WARNING cinder.quota [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1097472729-544250454 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1097472729-544250454, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:06:06 devstack cinder-volume[93503]: WARNING cinder.quota [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1097472729-544250454 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1097472729-544250454, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Created reservations ['6fbf3c37-e94c-4dc3-83ec-4b4d48b32c59', 'e30212bb-34f3-449f-a901-5ee227ffad43', 'e03c8ae3-d3cc-4725-a8cf-06c8673e4478', 'fdbfd85e-22cc-427d-87ad-7144a9025876'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:06 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:06:06 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:07 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.027s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:07 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:06:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Deleted volume successfully. Jun 27 20:06:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-866d5210-9257-41ea-9426-1985a5c0f89c tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-e32fe07a-8a0e-4d51-a127-d54b47a3d70b-delete_volume" released by "delete_volume" :: held 3.821s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-888cf762-05a5-4325-bff9-d68ca5ac0a08 req-7d80f068-df30-4f80-9425-e8ce21be30ec tempest-TestInstancesWithCinderVolumes-829353016 None] Terminate volume connection completed successfully. Jun 27 20:06:12 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-888cf762-05a5-4325-bff9-d68ca5ac0a08 req-7d80f068-df30-4f80-9425-e8ce21be30ec tempest-TestInstancesWithCinderVolumes-829353016 None] Deleting attachment 5f3c841f-1bcd-4c24-b039-898b69992e11. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:16 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:06:16 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "cinder-defe514a-af16-4406-b358-58425de18998-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-defe514a-af16-4406-b358-58425de18998-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "cinder-quobyte-defe514a-af16-4406-b358-58425de18998" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-quobyte-defe514a-af16-4406-b358-58425de18998" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae19e14b-9096-41a9-a164-19d03165c274]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:16 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:06:16 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:17 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.015s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:06:17 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 0 in 1.008s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:17 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:06:17 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:18 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 1 in 0.883s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:18 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998 Jun 27 20:06:18 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:19 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-defe514a-af16-4406-b358-58425de18998" returned: 0 in 0.852s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-quobyte-defe514a-af16-4406-b358-58425de18998" released by "delete_volume" :: held 2.833s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:19 devstack cinder-volume[93503]: WARNING cinder.quota [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1876673377-145358469 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1876673377-145358469, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:06:19 devstack cinder-volume[93503]: WARNING cinder.quota [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1876673377-145358469 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1876673377-145358469, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Created reservations ['36360179-37eb-4027-904e-7b074fe03719', '55a34c6e-0f76-42b3-8498-6b0f4e0c55a4', 'eccf09d7-6e12-4600-a308-18f5396bf5c3', 'bcc43177-1895-40f7-bc32-60120a75968f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:19 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:06:19 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:20 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.844s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:20 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:06:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Deleted volume successfully. Jun 27 20:06:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-46c29e96-3d1d-443f-a26f-6929bcd2e0b2 tempest-TestInstancesWithCinderVolumes-829353016 None] Lock "cinder-defe514a-af16-4406-b358-58425de18998-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.767s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Uploaded volume to glance image-id: 459abc81-f05f-40a2-9cac-21dd6524f824. {{(pid=93503) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.035s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bda8573-6f5a-466b-8ce2-397b3196a042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2e041085a44e2fbd72900c2aa2a292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:05:59Z,use_quota=True,user_id='fa9cd1f9dd8a4e65a7637b526a3e8dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce57a43-2ff3-4bc5-ac29-5dcc9c995e54),volume_type_id=2ce57a43-2ff3-4bc5-ac29-5dcc9c995e54)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Creating volume 5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:06:26 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:06:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:26 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 1073741824 Jun 27 20:06:26 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:26 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-63f74e6d-0d86-42ee-bbf2-eb72df5fa008 tempest-VolumesActionsTest-73872825 None] Copy volume to image completed successfully. Jun 27 20:06:27 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 1073741824" returned: 0 in 0.975s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:27 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:27 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:28 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 0 in 0.786s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.593s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab8c144-8e8b-4644-9c93-a073dc72c0d4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Attempting download of cf6a068b-72f1-4549-9c98-eb4be080f0f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'metadata': {}}])) to volume 5bda8573-6f5a-466b-8ce2-397b3196a042. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c17db4-7c2e-40f1-b0ce-3cf6792c56e0]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:28 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:06:28 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:28 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah Jun 27 20:06:28 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:29 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 1.067s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf3cd6-a676-4e43-874d-d8f548c35721]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:29 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah" returned: 0 in 1.077s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:29 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:06:29 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:29 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah Jun 27 20:06:29 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:30 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah" returned: 1 in 1.193s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6a068b-72f1-4549-9c98-eb4be080f0f5_hev7caah' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:30 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[622373db-82b4-478d-8995-b13828e28a78]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:30 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 1.305s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:30 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img Jun 27 20:06:30 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:31 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD Jun 27 20:06:31 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:31 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD" returned: 0 in 1.074s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:32 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD Jun 27 20:06:32 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:33 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD" returned: 1 in 1.499s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:33 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] cf6a068b-72f1-4549-9c98-eb4be080f0f5 was raw, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:06:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:33 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:33 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:35 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 0 in 1.787s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:35 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6a068b-72f1-4549-9c98-eb4be080f0f5_xzzbfa8bdevstack@QuobyteHD, size 0.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:06:35 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 20:06:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:35 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 1G Jun 27 20:06:35 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:36 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 1G" returned: 0 in 1.694s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5df940-d70d-4f7b-af2e-5990b2c8be00]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:37 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:37 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:37 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img" returned: 0 in 6.456s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ed328-1971-4715-90e7-2a414c0b97ec]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:37 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:06:37 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:37 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 0 in 0.849s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:38 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:38 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:38 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 0.996s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:06:38 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Converted 1024.00 MB image at 158.57 MB/s Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=61,cinder:UPDATE=60,cinder:INSERT=18,cinder:DELETE=4 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=62,cinder:UPDATE=66,cinder:DELETE=4,cinder:INSERT=12 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] 28dc13fd-f442-4507-9e5e-f32a6641a27b was raw, converting to qcow2 {{(pid=93503) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[af23cd2b-9ed2-4a07-b88d-28ed704bd6b7]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:38 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img Jun 27 20:06:38 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:39 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 1 in 1.090s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Downloaded image cf6a068b-72f1-4549-9c98-eb4be080f0f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'metadata': {}}])) to volume 5bda8573-6f5a-466b-8ce2-397b3196a042 successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Temporary image cf6a068b-72f1-4549-9c98-eb4be080f0f5 for user fa9cd1f9dd8a4e65a7637b526a3e8dfe is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Marking volume 5bda8573-6f5a-466b-8ce2-397b3196a042 as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Copying metadata from image cf6a068b-72f1-4549-9c98-eb4be080f0f5 to 5bda8573-6f5a-466b-8ce2-397b3196a042. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Creating volume glance metadata for volume 5bda8573-6f5a-466b-8ce2-397b3196a042 backed by image cf6a068b-72f1-4549-9c98-eb4be080f0f5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '21df739d748227743f95881249fc8a0d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4a3999-3667-4f67-91ef-3fd413cde69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bda8573-6f5a-466b-8ce2-397b3196a042', 'volume_size': 1, 'image_id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21df739d748227743f95881249fc8a0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a2e041085a44e2fbd72900c2aa2a292', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bf06ac1dbeb7bbc8f95637666e9cffdc35845cc6d6d64b7d1ec138b55ba150336f106ef7300538970192794c94d6183695bc470b118ae9860da46005adec868', 'id': 'cf6a068b-72f1-4549-9c98-eb4be080f0f5', 'created_at': datetime.datetime(2026, 6, 27, 18, 5, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 5, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6a068b-72f1-4549-9c98-eb4be080f0f5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b779cc90-3954-4d3a-b760-bac7fcd3654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:39 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Volume volume-5bda8573-6f5a-466b-8ce2-397b3196a042 (5bda8573-6f5a-466b-8ce2-397b3196a042): created successfully Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b779cc90-3954-4d3a-b760-bac7fcd3654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Flow 'volume_create_manager' (c0b47887-8bd1-4b95-8b88-fc3c89d3581b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1c2114de-615e-474a-afc9-7f0032bdacbb tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Created volume successfully. Jun 27 20:06:39 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img" returned: 0 in 1.220s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:39 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img Jun 27 20:06:39 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Acquiring lock "cinder-5bda8573-6f5a-466b-8ce2-397b3196a042-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "cinder-5bda8573-6f5a-466b-8ce2-397b3196a042-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Acquiring lock "cinder-quobyte-5bda8573-6f5a-466b-8ce2-397b3196a042" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "cinder-quobyte-5bda8573-6f5a-466b-8ce2-397b3196a042" acquired by "delete_volume" :: waited 0.051s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:40 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418655a-8040-49aa-9855-cfeb4d7ad574]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img" returned: 1 in 1.129s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:40 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf Jun 27 20:06:40 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:40 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:40 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf" returned: 0 in 1.280s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:42 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Image conversion details: src /opt/stack/data/cinder/conversion/b4585c3c-d3e9-4338-9220-b43b72fea5ff.temp_image.28dc13fd-f442-4507-9e5e-f32a6641a27b215dq7ls.img, size 1024.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:06:42 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Converted 1024.00 MB image at 798.69 MB/s Jun 27 20:06:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b02a9-cff9-41d6-b93f-e7d451167f1f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:42 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:42 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 0 in 1.368s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:42 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf Jun 27 20:06:42 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:42 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:42 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:43 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oaslv9sf" returned: 0 in 0.901s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:43 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 1 in 0.983s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:06:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:43 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042 Jun 27 20:06:43 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:44 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5bda8573-6f5a-466b-8ce2-397b3196a042" returned: 0 in 1.265s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "cinder-quobyte-5bda8573-6f5a-466b-8ce2-397b3196a042" released by "delete_volume" :: held 3.729s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:44 devstack cinder-volume[93503]: WARNING cinder.quota [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:06:44 devstack cinder-volume[93503]: WARNING cinder.quota [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Created reservations ['27707bdb-8708-4bef-bf2a-335a5700dad1', '0b0b6c16-2559-4c64-8adb-d8b70c2e53a9', 'b6cde9d0-5607-4c90-bc32-8f1d53eeceeb', 'f618879e-6784-453b-8c66-cb00561d43fb'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:44 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:06:44 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.147s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Uploaded volume to glance image-id: 28dc13fd-f442-4507-9e5e-f32a6641a27b. {{(pid=93503) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 27 20:06:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9a510b45-663a-496e-a5fb-23596805ffe0 tempest-VolumesActionsTest-73872825 None] Copy volume to image completed successfully. Jun 27 20:06:46 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.465s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:46 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:06:46 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Deleted volume successfully. Jun 27 20:06:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3b2b7e87-5a64-4a2e-9fac-1b777fe30b12 tempest-VolumeAndVolumeTypeFromImageTest-39971328 None] Lock "cinder-5bda8573-6f5a-466b-8ce2-397b3196a042-delete_volume" released by "delete_volume" :: held 5.664s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Acquiring lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Acquiring lock "cinder-quobyte-b4585c3c-d3e9-4338-9220-b43b72fea5ff" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:06:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Lock "cinder-quobyte-b4585c3c-d3e9-4338-9220-b43b72fea5ff" acquired by "delete_volume" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:06:47 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef9335-3a74-4429-b082-5c3e8b2f288a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:06:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:47 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:06:47 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:48 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 1.175s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:48 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff Jun 27 20:06:48 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:49 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b4585c3c-d3e9-4338-9220-b43b72fea5ff" returned: 0 in 1.350s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Lock "cinder-quobyte-b4585c3c-d3e9-4338-9220-b43b72fea5ff" released by "delete_volume" :: held 2.623s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Created reservations ['872a5751-a24c-4755-9072-d6964d97f619', '016641a6-88eb-4e9d-b8d0-d8a3b5346aff', '9aafb94e-f7d0-4f0d-8ddb-a54aa9972157', '63077e7c-931f-4399-be2b-7579e96b61c5'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:50 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:06:50 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:51 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.178s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:51 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:06:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Deleted volume successfully. Jun 27 20:06:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4b25de1f-ed76-4fac-b309-9ad5f3cb179d tempest-VolumesActionsTest-73872825 None] Lock "cinder-b4585c3c-d3e9-4338-9220-b43b72fea5ff-delete_volume" released by "delete_volume" :: held 4.158s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (cbd0fc26-517a-47b1-935f-8fb1c507de9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d38d80-a118-469a-ab4c-d23d939e29a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d38d80-a118-469a-ab4c-d23d939e29a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1982706610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ad6774-9176-40f4-b86d-b9e9429ce702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:53Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a04236-38a4-4e57-a007-c5acafb015ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a04236-38a4-4e57-a007-c5acafb015ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33ddea1-5b25-4514-aeaa-6de641b7f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33ddea1-5b25-4514-aeaa-6de641b7f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ad6774-9176-40f4-b86d-b9e9429ce702', 'volume_name': 'volume-88ad6774-9176-40f4-b86d-b9e9429ce702', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e695a488-6e90-458f-be67-22bff772f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e695a488-6e90-458f-be67-22bff772f243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5be5bf-79a9-4a09-8a92-26a7eaca758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume 88ad6774-9176-40f4-b86d-b9e9429ce702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ad6774-9176-40f4-b86d-b9e9429ce702', 'volume_size': 1} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1982706610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ad6774-9176-40f4-b86d-b9e9429ce702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:53Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Creating volume 88ad6774-9176-40f4-b86d-b9e9429ce702 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:06:53 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:06:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:53 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 1073741824 Jun 27 20:06:53 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:54 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 1073741824" returned: 0 in 1.135s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:54 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 Jun 27 20:06:54 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:55 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702" returned: 0 in 0.887s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5be5bf-79a9-4a09-8a92-26a7eaca758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ad6774-9176-40f4-b86d-b9e9429ce702', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3938f9-85c7-4932-bbe4-673c92081e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:55 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume volume-88ad6774-9176-40f4-b86d-b9e9429ce702 (88ad6774-9176-40f4-b86d-b9e9429ce702): created successfully Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3938f9-85c7-4932-bbe4-673c92081e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (cbd0fc26-517a-47b1-935f-8fb1c507de9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5ec41a7e-9b02-4eff-871b-c9459de09cca tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created volume successfully. Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (f8ff9382-bcaf-4db0-805d-2daec6eb61c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58108ae-927f-471d-a298-2af069463a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58108ae-927f-471d-a298-2af069463a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138145477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674888a8-3a34-4e18-a0e7-4944be35ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:57Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc27a2b-49ce-4744-a2df-5655c92aff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc27a2b-49ce-4744-a2df-5655c92aff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27828c8-c11e-405e-95e5-937a21579bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27828c8-c11e-405e-95e5-937a21579bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674888a8-3a34-4e18-a0e7-4944be35ad09', 'volume_name': 'volume-674888a8-3a34-4e18-a0e7-4944be35ad09', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392093f7-8bed-470c-8a04-7447d9bcf21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392093f7-8bed-470c-8a04-7447d9bcf21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d74ad71-db3a-4c39-a882-f221aff0c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume 674888a8-3a34-4e18-a0e7-4944be35ad09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674888a8-3a34-4e18-a0e7-4944be35ad09', 'volume_size': 1} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138145477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674888a8-3a34-4e18-a0e7-4944be35ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:57Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Creating volume 674888a8-3a34-4e18-a0e7-4944be35ad09 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:06:57 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:57 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 1073741824 Jun 27 20:06:57 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (eeb3ac9b-8228-4392-8c2d-f910212ca9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94d2f7d-37fd-4ebc-8927-419d653719ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94d2f7d-37fd-4ebc-8927-419d653719ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1252883765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7854bd38-43a2-43d9-8b24-19c5cb707923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:57Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b904ae-76ec-417e-9f03-d8cc57dab118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b904ae-76ec-417e-9f03-d8cc57dab118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df5e65-a320-473f-9cd0-f4e50b9be330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df5e65-a320-473f-9cd0-f4e50b9be330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7854bd38-43a2-43d9-8b24-19c5cb707923', 'volume_name': 'volume-7854bd38-43a2-43d9-8b24-19c5cb707923', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e782f6c-7d44-48e4-8c15-889d690762d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e782f6c-7d44-48e4-8c15-889d690762d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5ddc80-e4f6-444a-b6ad-ecf676505fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume 7854bd38-43a2-43d9-8b24-19c5cb707923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7854bd38-43a2-43d9-8b24-19c5cb707923', 'volume_size': 1} Jun 27 20:06:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (194d47f5-250f-478f-abd7-6601ee2e3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dc0601-572d-45bc-a225-b943eeb441a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dc0601-572d-45bc-a225-b943eeb441a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464524382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7377a9ea-564d-4eb9-87df-bd0e7e2ac141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:58Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4179a3ee-92aa-450d-a3bb-bc5cc1f2d9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4179a3ee-92aa-450d-a3bb-bc5cc1f2d9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fca03c-1333-42d7-83c2-54886b90aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fca03c-1333-42d7-83c2-54886b90aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7377a9ea-564d-4eb9-87df-bd0e7e2ac141', 'volume_name': 'volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de7d90-7374-4fb3-9338-32a08eee0810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de7d90-7374-4fb3-9338-32a08eee0810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7b64cd-cff7-4dea-bbac-a8c363b656dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:58 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume 7377a9ea-564d-4eb9-87df-bd0e7e2ac141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141', 'volume_size': 1} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:58 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 1073741824" returned: 0 in 1.139s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:58 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 Jun 27 20:06:58 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (6c276f1c-415c-458d-a670-a502300aeb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4530d04d-da4e-468b-90ad-0434a10c2fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4530d04d-da4e-468b-90ad-0434a10c2fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1735047543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f962ff-d881-43b3-979f-5282e6d6683a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:59Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17367e2-2dbf-4728-a01e-858786f8eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17367e2-2dbf-4728-a01e-858786f8eaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03ef577-bbca-400e-b74e-d809d1fda420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03ef577-bbca-400e-b74e-d809d1fda420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f962ff-d881-43b3-979f-5282e6d6683a', 'volume_name': 'volume-b8f962ff-d881-43b3-979f-5282e6d6683a', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91eb558-121a-4c2e-8c56-77c25326f818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91eb558-121a-4c2e-8c56-77c25326f818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c3adc9-7b88-4f97-8977-3aaa8ddf6548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume b8f962ff-d881-43b3-979f-5282e6d6683a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f962ff-d881-43b3-979f-5282e6d6683a', 'volume_size': 1} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09" returned: 0 in 0.972s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1252883765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7854bd38-43a2-43d9-8b24-19c5cb707923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:57Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Creating volume 7854bd38-43a2-43d9-8b24-19c5cb707923 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:06:59 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:06:59 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 1073741824 Jun 27 20:06:59 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d74ad71-db3a-4c39-a882-f221aff0c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674888a8-3a34-4e18-a0e7-4944be35ad09', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a827d85-0e6c-488e-94ad-6b60ef3c4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Flow 'volume_create_manager' (29d186f3-0246-41a3-8dd8-c2d28001be8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36e259e-0ff3-4c0a-9b40-705e32d2bb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (b210bd9b-3986-4556-bc82-01677d28d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b74f8c3-6575-472a-90e5-4c86a40532a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume volume-674888a8-3a34-4e18-a0e7-4944be35ad09 (674888a8-3a34-4e18-a0e7-4944be35ad09): created successfully Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a827d85-0e6c-488e-94ad-6b60ef3c4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (f8ff9382-bcaf-4db0-805d-2daec6eb61c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b74f8c3-6575-472a-90e5-4c86a40532a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586245298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05087f8c-9a2e-4ce6-a6d1-2c314fada1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:59Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822fc4d7-6c43-4a2b-8d7b-d6be1c0d406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822fc4d7-6c43-4a2b-8d7b-d6be1c0d406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad655c8-206f-445e-98ab-0c097ac1f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad655c8-206f-445e-98ab-0c097ac1f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05087f8c-9a2e-4ce6-a6d1-2c314fada1be', 'volume_name': 'volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5c44c9-6eb7-410e-bea5-4edc7bcfb12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5c44c9-6eb7-410e-bea5-4edc7bcfb12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938505ac-2969-4aa7-a756-c0455965b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume 05087f8c-9a2e-4ce6-a6d1-2c314fada1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be', 'volume_size': 1} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36e259e-0ff3-4c0a-9b40-705e32d2bb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1430275941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71434ebc02bd4edd92251cb050305c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:59Z,use_quota=True,user_id='fe28ed9b115c44a2b9aaab19a6909986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b106a6b-d4e5-4999-a2c9-8293887de581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b106a6b-d4e5-4999-a2c9-8293887de581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4cf832-1822-49a0-9d6c-cfad6f1aef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4cf832-1822-49a0-9d6c-cfad6f1aef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8', 'volume_name': 'volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8', 'volume_size': 2}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f1966a-6774-4873-8342-3712b526503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f1966a-6774-4873-8342-3712b526503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea0a66a-f5dc-4774-8c79-f2e0e6de2dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:06:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Volume aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8', 'volume_size': 2} Jun 27 20:06:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:06:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-af77ac6c-5a21-4c8a-bbb6-eb7f868ee65e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created volume successfully. Jun 27 20:07:00 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 1073741824" returned: 0 in 1.153s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:00 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 Jun 27 20:07:00 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:01 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923" returned: 0 in 0.723s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.022s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464524382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7377a9ea-564d-4eb9-87df-bd0e7e2ac141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:58Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Creating volume 7377a9ea-564d-4eb9-87df-bd0e7e2ac141 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:01 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5ddc80-e4f6-444a-b6ad-ecf676505fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7854bd38-43a2-43d9-8b24-19c5cb707923', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:01 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 1073741824 Jun 27 20:07:01 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c6bc39-888e-421f-ab25-680a13776b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume volume-7854bd38-43a2-43d9-8b24-19c5cb707923 (7854bd38-43a2-43d9-8b24-19c5cb707923): created successfully Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c6bc39-888e-421f-ab25-680a13776b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (eeb3ac9b-8228-4392-8c2d-f910212ca9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:01 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a5915eec-351e-420b-a4a9-4513326d4abf tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created volume successfully. Jun 27 20:07:02 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 1073741824" returned: 0 in 1.151s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:02 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 Jun 27 20:07:02 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:03 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1735047543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f962ff-d881-43b3-979f-5282e6d6683a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:59Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Creating volume b8f962ff-d881-43b3-979f-5282e6d6683a {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:03 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7b64cd-cff7-4dea-bbac-a8c363b656dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:03 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a 1073741824 Jun 27 20:07:03 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11584743-4ae8-4936-a80d-330537c23404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:03 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 (7377a9ea-564d-4eb9-87df-bd0e7e2ac141): created successfully Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11584743-4ae8-4936-a80d-330537c23404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (194d47f5-250f-478f-abd7-6601ee2e3e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-85d96662-2776-4ddc-b0a3-3a33f7844cab tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created volume successfully. Jun 27 20:07:04 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a 1073741824" returned: 0 in 0.963s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:04 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a Jun 27 20:07:04 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:04 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a" returned: 0 in 0.665s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.255s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586245298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05087f8c-9a2e-4ce6-a6d1-2c314fada1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f942ec0e1347ad8b372e6fad0248cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:59Z,use_quota=True,user_id='bd3aa56de4504870ae41a8cfe2918166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Creating volume 05087f8c-9a2e-4ce6-a6d1-2c314fada1be {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:04 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:04 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be 1073741824 Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c3adc9-7b88-4f97-8977-3aaa8ddf6548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f962ff-d881-43b3-979f-5282e6d6683a', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:04 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3517637-959c-4cad-b984-9adb9cce13be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:04 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume volume-b8f962ff-d881-43b3-979f-5282e6d6683a (b8f962ff-d881-43b3-979f-5282e6d6683a): created successfully Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3517637-959c-4cad-b984-9adb9cce13be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (6c276f1c-415c-458d-a670-a502300aeb1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5a4120ee-718e-43f4-b66d-b7a33c795790 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created volume successfully. Jun 27 20:07:05 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be 1073741824" returned: 0 in 0.960s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:05 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be Jun 27 20:07:05 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:06 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be" returned: 0 in 0.753s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.975s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1430275941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71434ebc02bd4edd92251cb050305c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:06:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:06:59Z,use_quota=True,user_id='fe28ed9b115c44a2b9aaab19a6909986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Creating volume aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:06 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 2147483648 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938505ac-2969-4aa7-a756-c0455965b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cbcd14-2740-4247-9133-14ebbb18271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:06 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 2147483648 Jun 27 20:07:06 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:06 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Volume volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be (05087f8c-9a2e-4ce6-a6d1-2c314fada1be): created successfully Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cbcd14-2740-4247-9133-14ebbb18271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Flow 'volume_create_manager' (b210bd9b-3986-4556-bc82-01677d28d38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-62261f73-e49f-427f-b286-0ed997189971 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created volume successfully. Jun 27 20:07:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-05087f8c-9a2e-4ce6-a6d1-2c314fada1be-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-05087f8c-9a2e-4ce6-a6d1-2c314fada1be-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-quobyte-05087f8c-9a2e-4ce6-a6d1-2c314fada1be" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-05087f8c-9a2e-4ce6-a6d1-2c314fada1be" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:07 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc673c45-182f-4d62-858c-780d10af5ad6]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:07 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be Jun 27 20:07:07 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:08 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 2147483648" returned: 0 in 1.542s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Flow 'volume_create_manager' (67202366-9568-40c8-9d60-53735657c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31de5043-7e6d-4742-8057-77daf2f9008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31de5043-7e6d-4742-8057-77daf2f9008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-541961997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42d774f-34b3-41ab-b533-94a1179710b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a29711b7b047afa4222211d8446b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:08Z,use_quota=True,user_id='32a16e496bb84508994121c67a8caf3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b1641d-70e1-47e1-bfea-385ba5b8276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b1641d-70e1-47e1-bfea-385ba5b8276e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b99929-75b0-4df5-8a73-1da930088bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b99929-75b0-4df5-8a73-1da930088bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42d774f-34b3-41ab-b533-94a1179710b6', 'volume_name': 'volume-b42d774f-34b3-41ab-b533-94a1179710b6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981e80e7-fd94-49bb-9e5b-5d9816a41ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981e80e7-fd94-49bb-9e5b-5d9816a41ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ac51e4-8989-46d5-b316-6e768e6d2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:08 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Volume b42d774f-34b3-41ab-b533-94a1179710b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42d774f-34b3-41ab-b533-94a1179710b6', 'volume_size': 1} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:08 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be" returned: 0 in 1.110s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:08 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 Jun 27 20:07:08 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:08 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be Jun 27 20:07:08 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:09 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-05087f8c-9a2e-4ce6-a6d1-2c314fada1be" returned: 0 in 0.748s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:09 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8" returned: 0 in 0.785s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-05087f8c-9a2e-4ce6-a6d1-2c314fada1be" released by "delete_volume" :: held 1.941s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-541961997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42d774f-34b3-41ab-b533-94a1179710b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a29711b7b047afa4222211d8446b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:08Z,use_quota=True,user_id='32a16e496bb84508994121c67a8caf3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Creating volume b42d774f-34b3-41ab-b533-94a1179710b6 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:09 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:09 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 1073741824 Jun 27 20:07:09 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea0a66a-f5dc-4774-8c79-f2e0e6de2dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8', 'volume_size': 2}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6925e20-f8dd-4cdc-abc1-55f66fdbd987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:09 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Volume volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 (aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8): created successfully Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6925e20-f8dd-4cdc-abc1-55f66fdbd987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Flow 'volume_create_manager' (29d186f3-0246-41a3-8dd8-c2d28001be8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9e0e05e8-3e90-4297-9a96-64e63e266354 tempest-VolumesCloneNegativeTest-18116253 None] Created volume successfully. Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created reservations ['4c55b973-4fe7-45d4-a1d3-9a443cdf5139', '6e2d54e3-2a96-4aa0-936a-341faf801220', 'eecfdfe4-2235-4b11-adca-593f77d6023d', 'c513948e-1bcf-49c8-a8be-000b3780326b'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:09 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:09 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Acquiring lock "cinder-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Lock "cinder-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Acquiring lock "cinder-quobyte-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Lock "cinder-quobyte-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f72cb-6e8c-47f6-b133-29746c8e34d4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:10 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 1073741824" returned: 0 in 1.004s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:10 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.817s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Deleted volume successfully. Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:10 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 Jun 27 20:07:10 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-224dd372-c051-4fa0-b155-0551543c6ea6 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-05087f8c-9a2e-4ce6-a6d1-2c314fada1be-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:10 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 Jun 27 20:07:10 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-b8f962ff-d881-43b3-979f-5282e6d6683a-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-b8f962ff-d881-43b3-979f-5282e6d6683a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-quobyte-b8f962ff-d881-43b3-979f-5282e6d6683a" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-b8f962ff-d881-43b3-979f-5282e6d6683a" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaf9cf4-d60e-4d64-85a1-43f28e18a463]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:10 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a Jun 27 20:07:10 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:11 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6" returned: 0 in 0.881s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ac51e4-8989-46d5-b316-6e768e6d2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42d774f-34b3-41ab-b533-94a1179710b6', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1850a5-ffda-4d08-abc5-f53ca83567e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Volume volume-b42d774f-34b3-41ab-b533-94a1179710b6 (b42d774f-34b3-41ab-b533-94a1179710b6): created successfully Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1850a5-ffda-4d08-abc5-f53ca83567e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Flow 'volume_create_manager' (67202366-9568-40c8-9d60-53735657c25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5ab0a46e-2c3e-4102-9fef-59a209662e68 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Created volume successfully. Jun 27 20:07:11 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8" returned: 0 in 1.110s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:11 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8 Jun 27 20:07:11 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:11 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a" returned: 0 in 0.972s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:11 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a Jun 27 20:07:11 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:11 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8" returned: 0 in 0.766s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Lock "cinder-quobyte-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8" released by "delete_volume" :: held 1.937s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:11 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Created reservations ['7e4c9e5a-4473-46c2-9bf7-f7086462c7d6', 'ced508e8-a224-4235-9850-6d828b90ffc5', '9f6aece7-2dd1-4ec0-9ef8-425c71e3887e', 'b816b923-6c37-4360-88d2-e2a770aeaadb'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:12 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:12 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:12 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b8f962ff-d881-43b3-979f-5282e6d6683a" returned: 0 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-b8f962ff-d881-43b3-979f-5282e6d6683a" released by "delete_volume" :: held 1.764s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created reservations ['84457c27-85ac-4874-8a09-a881841333a9', 'abd6a10a-bb37-4541-995b-5c126dd62a94', '0c96e3e8-77fa-43c1-b1cd-1c545eaa261a', '9cd4663b-6738-4b9d-960d-bd4bedc1638a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:12 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:12 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-7377a9ea-564d-4eb9-87df-bd0e7e2ac141-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-7377a9ea-564d-4eb9-87df-bd0e7e2ac141-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:12 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-quobyte-7377a9ea-564d-4eb9-87df-bd0e7e2ac141" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.878s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Deleted volume successfully. Jun 27 20:07:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-7377a9ea-564d-4eb9-87df-bd0e7e2ac141" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f556f-1225-4e89-b79c-63aa51da1741]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ea5f8762-f294-4ab6-8fa7-2ad8f4b3a54c tempest-VolumesCloneNegativeTest-18116253 None] Lock "cinder-aa5ecb2a-2397-42ef-8d6d-7ae5cabe5ba8-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:13 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 Jun 27 20:07:13 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:13 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.956s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:13 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Deleted volume successfully. Jun 27 20:07:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-aa653c66-ee14-40d1-b90d-a47e9ce2da2c tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-b8f962ff-d881-43b3-979f-5282e6d6683a-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:14 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141" returned: 0 in 1.016s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:14 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141 Jun 27 20:07:14 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9f929-e802-48be-b781-ea1ff6601c19]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:14 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 Jun 27 20:07:14 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:14 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7377a9ea-564d-4eb9-87df-bd0e7e2ac141" returned: 0 in 0.693s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-7377a9ea-564d-4eb9-87df-bd0e7e2ac141" released by "delete_volume" :: held 1.768s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created reservations ['e64e2f2c-3de0-45cd-a67d-24e0d2f0d58c', '4496935f-b566-40e1-b9ab-6b0c2f6ebcc7', '923873ab-5c34-4a5d-bfe6-7005e73cb4fe', '99c257c6-05fc-41b4-a34c-2523c361fe29'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:14 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:14 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-7854bd38-43a2-43d9-8b24-19c5cb707923-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-7854bd38-43a2-43d9-8b24-19c5cb707923-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-quobyte-7854bd38-43a2-43d9-8b24-19c5cb707923" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-7854bd38-43a2-43d9-8b24-19c5cb707923" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc9ef04-afb4-4e4f-831f-a7e3cb477911]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:15 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 Jun 27 20:07:15 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:15 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6" returned: 0 in 1.026s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.044s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-b42d774f-34b3-41ab-b533-94a1179710b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b9b0a97-8c16-4f4b-8271-5d162e5b571e', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:07:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-19fdb25f-93cb-4615-bd45-1ff047d9b118 req-981b59d0-b333-4f9d-a8fd-96ee4741a399 tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] attachment_update completed successfully. Jun 27 20:07:15 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.928s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Deleted volume successfully. Jun 27 20:07:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e5663a6d-f237-428e-ab4b-e7d7a7097a09 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-7377a9ea-564d-4eb9-87df-bd0e7e2ac141-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:16 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923" returned: 0 in 0.922s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:16 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:16 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:16 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923 Jun 27 20:07:16 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Flow 'volume_create_manager' (a42b35f9-9bf4-43d1-84a4-828c11d074ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d45ea09-9275-4410-8495-7ccc98cb09c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d45ea09-9275-4410-8495-7ccc98cb09c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1167335705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bbb8ee-d19c-437e-ad86-352c13f66453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c57a40afd7c452b80c30b77faf3c121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:16Z,use_quota=True,user_id='dccce4d386534f83b1e5acd54600f31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677f6447-3419-41f6-a7b0-cc5891b36677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677f6447-3419-41f6-a7b0-cc5891b36677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801bcdd3-3993-44a8-9bd7-72a950c4fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801bcdd3-3993-44a8-9bd7-72a950c4fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53bbb8ee-d19c-437e-ad86-352c13f66453', 'volume_name': 'volume-53bbb8ee-d19c-437e-ad86-352c13f66453', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174bbf14-8ce2-4839-8dcb-c8353883c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174bbf14-8ce2-4839-8dcb-c8353883c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5e9b6c-0edb-463b-84b1-1c9442a9811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:16 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Volume 53bbb8ee-d19c-437e-ad86-352c13f66453: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53bbb8ee-d19c-437e-ad86-352c13f66453', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 20:07:16 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Trying to clone 53bbb8ee-d19c-437e-ad86-352c13f66453 from image 45e3a23f-5037-4170-820b-7e6bcfe7854f at location (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:07:17 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.934s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:07:17 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7854bd38-43a2-43d9-8b24-19c5cb707923" returned: 0 in 0.950s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-7854bd38-43a2-43d9-8b24-19c5cb707923" released by "delete_volume" :: held 1.937s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created reservations ['ad3ef2b2-e3bf-45d9-bf1e-78ca963d71e3', '7bcf9b9b-bc05-4fd5-982e-5e44e450fb41', '04ea433f-d4d4-4b88-8ba0-a79b53773799', '505bd72e-20d8-4791-8186-52d27660f8a6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:07:17 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Image download 20.69 MB at 20.69 MB/s Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f80970-3b9c-433e-8db0-6f144e0826c9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:17 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:17 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:17 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD Jun 27 20:07:17 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:18 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:18 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-674888a8-3a34-4e18-a0e7-4944be35ad09-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.053s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD" returned: 0 in 1.114s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f is fetched for user dccce4d386534f83b1e5acd54600f31f. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:07:18 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Deleted volume successfully. Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-674888a8-3a34-4e18-a0e7-4944be35ad09-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-af27e0ff-f98a-4ff6-b8a0-2ce89a04f89d tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-7854bd38-43a2-43d9-8b24-19c5cb707923-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-quobyte-674888a8-3a34-4e18-a0e7-4944be35ad09" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-674888a8-3a34-4e18-a0e7-4944be35ad09" acquired by "delete_volume" :: waited 0.047s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633a48b-c83b-4d6a-8c10-e85ca13db636]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e8a3f5-147f-4d7d-9bfb-c723f2b7f91a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:18 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 Jun 27 20:07:18 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:19 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD Jun 27 20:07:19 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:19 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD" returned: 0 in 1.066s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1167335705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bbb8ee-d19c-437e-ad86-352c13f66453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c57a40afd7c452b80c30b77faf3c121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:16Z,use_quota=True,user_id='dccce4d386534f83b1e5acd54600f31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Creating volume 53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:19 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:19 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09" returned: 0 in 1.080s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:19 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 1073741824 Jun 27 20:07:19 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:19 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09 Jun 27 20:07:19 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:20 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-674888a8-3a34-4e18-a0e7-4944be35ad09" returned: 0 in 0.861s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-674888a8-3a34-4e18-a0e7-4944be35ad09" released by "delete_volume" :: held 2.021s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:20 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created reservations ['8cbcce93-ac50-426f-97a1-a6e7bcdcee9b', 'db4afdc1-6cf7-435e-afff-9889c6d0ff8a', 'd1d0ca20-1406-4382-b835-202fda853a56', 'ceb0503d-1fa7-4e4f-9c60-f80af502e6ab'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:21 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 1073741824" returned: 0 in 1.109s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:21 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:21 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:21 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:21 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:21 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.741s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:21 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Deleted volume successfully. Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8ee5f80f-2006-47bf-a709-3c8f307fe84e tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-674888a8-3a34-4e18-a0e7-4944be35ad09-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:21 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Attempting download of 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 53bbb8ee-d19c-437e-ad86-352c13f66453. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b99d2-8fbc-4d1d-a649-fc3b64c53468]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-88ad6774-9176-40f4-b86d-b9e9429ce702-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:22 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h Jun 27 20:07:22 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-88ad6774-9176-40f4-b86d-b9e9429ce702-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "cinder-quobyte-88ad6774-9176-40f4-b86d-b9e9429ce702" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-88ad6774-9176-40f4-b86d-b9e9429ce702" acquired by "delete_volume" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304e93a-ad04-47e4-b84d-3bf34a5f04a1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:22 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 Jun 27 20:07:22 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:22 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h" returned: 0 in 0.803s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:22 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h Jun 27 20:07:22 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:23 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702" returned: 0 in 0.841s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:23 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702 Jun 27 20:07:23 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:23 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h" returned: 1 in 0.792s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_y9hz8b6h' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c49413b-057c-4b29-8a09-6a72a5041ae4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:23 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD Jun 27 20:07:23 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:23 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-88ad6774-9176-40f4-b86d-b9e9429ce702" returned: 0 in 0.771s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-quobyte-88ad6774-9176-40f4-b86d-b9e9429ce702" released by "delete_volume" :: held 1.696s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-08336206-82bd-4159-bf30-44a87c0baf5a req-a8fef0bd-b273-45b0-8f8e-4c527689d51a tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Terminate volume connection completed successfully. Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-08336206-82bd-4159-bf30-44a87c0baf5a req-a8fef0bd-b273-45b0-8f8e-4c527689d51a tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Deleting attachment 3b9b0a97-8c16-4f4b-8271-5d162e5b571e. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:07:23 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Created reservations ['004f2236-0671-49dc-8fde-12c27eb8503f', '9fc82b00-8a46-4f1b-8d3b-623b4872b951', '3a7690e5-d01b-476f-bfc2-5b6d65eeae3a', 'd754cf18-a61a-4484-bb14-a47885adad38'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:24 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:24 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:24 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD" returned: 0 in 0.817s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] 45e3a23f-5037-4170-820b-7e6bcfe7854f was qcow2, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:24 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:24 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:24 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.773s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Deleted volume successfully. Jun 27 20:07:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b33a26eb-0813-4e00-b103-0548f8092551 tempest-CreateVolumesFromSourceVolumeTest-2145221487 None] Lock "cinder-88ad6774-9176-40f4-b86d-b9e9429ce702-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Acquiring lock "cinder-b42d774f-34b3-41ab-b533-94a1179710b6-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "cinder-b42d774f-34b3-41ab-b533-94a1179710b6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Acquiring lock "cinder-quobyte-b42d774f-34b3-41ab-b533-94a1179710b6" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "cinder-quobyte-b42d774f-34b3-41ab-b533-94a1179710b6" acquired by "delete_volume" :: waited 0.045s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0c5291-5ada-4563-9ff4-f18b950abf72]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:26 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 Jun 27 20:07:26 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:27 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 0 in 3.133s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:27 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_x_414cg4devstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:07:27 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Converted 112.00 MB image at 35.72 MB/s Jun 27 20:07:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:27 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 1G Jun 27 20:07:27 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:27 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6" returned: 0 in 1.213s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:27 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6 Jun 27 20:07:27 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:28 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 1G" returned: 0 in 1.313s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b565bfbc-8017-4b54-8189-e6b0689af747]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:28 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b42d774f-34b3-41ab-b533-94a1179710b6" returned: 0 in 1.239s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "cinder-quobyte-b42d774f-34b3-41ab-b533-94a1179710b6" released by "delete_volume" :: held 2.556s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:29 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:29 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Created reservations ['6a4d6573-4d17-4c6d-b5bd-7195e143fa81', '3014fff5-98b3-411a-a364-a44a9328fcd6', 'dc1234f6-3a09-40ca-87ec-96ab55164741', 'ee0d1423-91fe-4ed9-acd4-816df6d39749'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:29 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:29 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Flow 'volume_create_manager' (544b40dd-2ec0-414b-bb4f-f250d42a89ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b028bf-7043-4547-a05d-065076bc1900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b028bf-7043-4547-a05d-065076bc1900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-832838332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fea45b-2d5d-4d14-af64-1a676d44e59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8795c2a25ae64d8a99b1a527b1c4818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:29Z,use_quota=True,user_id='f5ca7ee99ff244879e6c2f9f86b053a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b2236f-8126-4279-bc0c-0d59d8c95d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b2236f-8126-4279-bc0c-0d59d8c95d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79765cd1-68e0-46ee-95c2-a8e55e112ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79765cd1-68e0-46ee-95c2-a8e55e112ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fea45b-2d5d-4d14-af64-1a676d44e59e', 'volume_name': 'volume-58fea45b-2d5d-4d14-af64-1a676d44e59e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250c7ece-9a06-48c7-bcc4-962697094380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250c7ece-9a06-48c7-bcc4-962697094380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1f8cb0-ffe7-435a-a404-88e37cd87dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:29 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Volume 58fea45b-2d5d-4d14-af64-1a676d44e59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fea45b-2d5d-4d14-af64-1a676d44e59e', 'volume_size': 1} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-832838332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fea45b-2d5d-4d14-af64-1a676d44e59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8795c2a25ae64d8a99b1a527b1c4818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:29Z,use_quota=True,user_id='f5ca7ee99ff244879e6c2f9f86b053a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Creating volume 58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:29 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:29 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e 1073741824 Jun 27 20:07:29 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:30 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.017s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:30 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:30 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Deleted volume successfully. Jun 27 20:07:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d2594c41-49ff-40a0-abd4-acdf96e7c92c tempest-TestServerVolumeAttachScenarioOldVersion-85440401 None] Lock "cinder-b42d774f-34b3-41ab-b533-94a1179710b6-delete_volume" released by "delete_volume" :: held 4.041s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:30 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 0 in 1.612s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:30 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:30 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:31 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e 1073741824" returned: 0 in 1.363s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:31 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:07:31 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:07:32 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Flow 'volume_create_manager' (a1404950-14da-4c80-acb1-2deb08e3eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d8b258-278d-40f0-8277-b4029af5db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 1 in 1.849s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Downloaded image 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 53bbb8ee-d19c-437e-ad86-352c13f66453 successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f for user dccce4d386534f83b1e5acd54600f31f is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Marking volume 53bbb8ee-d19c-437e-ad86-352c13f66453 as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d8b258-278d-40f0-8277-b4029af5db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-179618481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8784703d-843a-4ece-bbdb-e9d39a66ec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74066b5cb6c548479e6af43a38b3ddcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:32Z,use_quota=True,user_id='95e197df58e64466926e6aa1ec0cc443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e77178a-e2ae-4b59-8121-177af3a2436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e77178a-e2ae-4b59-8121-177af3a2436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d18bb9-50cf-40d8-8fd4-1239f539c3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d18bb9-50cf-40d8-8fd4-1239f539c3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8784703d-843a-4ece-bbdb-e9d39a66ec55', 'volume_name': 'volume-8784703d-843a-4ece-bbdb-e9d39a66ec55', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccac812-afdc-4ba0-9e01-8d62dcd58ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccac812-afdc-4ba0-9e01-8d62dcd58ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df32afa3-d5b4-4a96-9f02-8dd5b1969bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Volume 8784703d-843a-4ece-bbdb-e9d39a66ec55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8784703d-843a-4ece-bbdb-e9d39a66ec55', 'volume_size': 1} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Copying metadata from image 45e3a23f-5037-4170-820b-7e6bcfe7854f to 53bbb8ee-d19c-437e-ad86-352c13f66453. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Creating volume glance metadata for volume 53bbb8ee-d19c-437e-ad86-352c13f66453 backed by image 45e3a23f-5037-4170-820b-7e6bcfe7854f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:07:32 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 1.376s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] <== create_volume: return (2799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.807s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.059s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-179618481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8784703d-843a-4ece-bbdb-e9d39a66ec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74066b5cb6c548479e6af43a38b3ddcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:32Z,use_quota=True,user_id='95e197df58e64466926e6aa1ec0cc443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Creating volume 8784703d-843a-4ece-bbdb-e9d39a66ec55 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:32 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1f8cb0-ffe7-435a-a404-88e37cd87dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fea45b-2d5d-4d14-af64-1a676d44e59e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 1073741824 Jun 27 20:07:32 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3606ff5-3aab-4754-a14f-715a53aeb49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Volume volume-58fea45b-2d5d-4d14-af64-1a676d44e59e (58fea45b-2d5d-4d14-af64-1a676d44e59e): created successfully Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3606ff5-3aab-4754-a14f-715a53aeb49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Flow 'volume_create_manager' (544b40dd-2ec0-414b-bb4f-f250d42a89ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-48548673-7068-4825-9579-daccd64b03b3 tempest-VolumeDependencyTests-564126909 None] Created volume successfully. Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5e9b6c-0edb-463b-84b1-1c9442a9811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bbb8ee-d19c-437e-ad86-352c13f66453', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec804e7c-fc61-4a06-b65a-2e9ceeb484ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:32 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Volume volume-53bbb8ee-d19c-437e-ad86-352c13f66453 (53bbb8ee-d19c-437e-ad86-352c13f66453): created successfully Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec804e7c-fc61-4a06-b65a-2e9ceeb484ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Flow 'volume_create_manager' (a42b35f9-9bf4-43d1-84a4-828c11d074ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-53014c91-ba85-4739-8a39-865e0f1095d5 tempest-VolumesExtendTest-2073777421 None] Created volume successfully. Jun 27 20:07:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:33 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 1073741824" returned: 0 in 1.296s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:33 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 Jun 27 20:07:33 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:34 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55" returned: 0 in 0.798s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.489s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df32afa3-d5b4-4a96-9f02-8dd5b1969bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8784703d-843a-4ece-bbdb-e9d39a66ec55', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ecc6a-9e7e-4581-aba0-05ba7d9af3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Creating offline snapshot 35692e29-ccef-43ab-b508-b3744e6b4326 of volume 58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:07:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Volume volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 (8784703d-843a-4ece-bbdb-e9d39a66ec55): created successfully Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ecc6a-9e7e-4581-aba0-05ba7d9af3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Flow 'volume_create_manager' (a1404950-14da-4c80-acb1-2deb08e3eb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7c0469-2eb2-4ed0-b7af-6ed78285acc4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:34 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-48893a0d-604b-403d-b34f-b3f965344846 tempest-TestMinimumBasicScenario-880518633 None] Created volume successfully. Jun 27 20:07:34 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:07:34 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:35 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 0.864s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:35 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 1G Jun 27 20:07:35 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:36 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 1G" returned: 0 in 0.902s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fea45b-2d5d-4d14-af64-1a676d44e59e -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:36 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fea45b-2d5d-4d14-af64-1a676d44e59e -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 Jun 27 20:07:36 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:37 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fea45b-2d5d-4d14-af64-1a676d44e59e -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326" returned: 0 in 0.784s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:37 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 is being set with open permissions: ugo+rw Jun 27 20:07:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:37 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 Jun 27 20:07:37 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:38 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326" returned: 0 in 0.718s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:38 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info Jun 27 20:07:38 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=121,cinder:SELECT=99,cinder:INSERT=41,cinder:DELETE=13 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=92,cinder:INSERT=33,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info" returned: 0 in 0.805s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:38 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:38 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info is being set with open permissions: ugo+rw Jun 27 20:07:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:38 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info Jun 27 20:07:39 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:39 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.info" returned: 0 in 0.731s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.969s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.431s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6156a582-285b-4548-8b2d-ad4a761d9191]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a2fb7bf0-c2ae-4452-9312-0fac7fed4c81 tempest-VolumeDependencyTests-564126909 None] Create snapshot completed successfully Jun 27 20:07:39 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:39 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:40 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 0 in 0.918s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:40 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:40 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Flow 'volume_create_manager' (e8acf399-97f8-4207-a671-09d0c62510c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebc19a5-457e-4893-8b3f-a4fa81625b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebc19a5-457e-4893-8b3f-a4fa81625b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-897651506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e348c-68a1-4ab1-b330-dceb4c78afac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8795c2a25ae64d8a99b1a527b1c4818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35692e29-ccef-43ab-b508-b3744e6b4326,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:41Z,use_quota=True,user_id='f5ca7ee99ff244879e6c2f9f86b053a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51824944-5775-40a3-a955-581ac4b1c3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51824944-5775-40a3-a955-581ac4b1c3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc5a036-f144-4ccf-9f09-03912f115d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc5a036-f144-4ccf-9f09-03912f115d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a0e348c-68a1-4ab1-b330-dceb4c78afac', 'volume_name': 'volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac', 'volume_size': 1, 'snapshot_id': '35692e29-ccef-43ab-b508-b3744e6b4326'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0eb2b5-aad6-4f2e-a8e9-79c9c8f35134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0eb2b5-aad6-4f2e-a8e9-79c9c8f35134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b109a2-acbf-40c5-af50-7732da553d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:41 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Volume 5a0e348c-68a1-4ab1-b330-dceb4c78afac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac', 'volume_size': 1, 'snapshot_id': '35692e29-ccef-43ab-b508-b3744e6b4326'} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:41 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 1 in 0.901s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 2G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 2G" returned: 0 in 0.079s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.953s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.943s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e51fd5-e801-49f5-99cf-753846c60ce2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:41 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4014b966-7756-4a01-809d-59c0ee974103 tempest-VolumesExtendTest-2073777421 None] Extend volume completed successfully. Jun 27 20:07:41 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 Jun 27 20:07:41 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-53bbb8ee-d19c-437e-ad86-352c13f66453-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Lock "cinder-53bbb8ee-d19c-437e-ad86-352c13f66453-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-quobyte-53bbb8ee-d19c-437e-ad86-352c13f66453" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-53bbb8ee-d19c-437e-ad86-352c13f66453" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f222f-d95a-49df-a865-88ac7646d6fd]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:42 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55" returned: 0 in 1.061s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.084s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.355s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-quobyte-35692e29-ccef-43ab-b508-b3744e6b4326-5a0e348c-68a1-4ab1-b330-dceb4c78afac" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:42 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:42 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-35692e29-ccef-43ab-b508-b3744e6b4326-5a0e348c-68a1-4ab1-b330-dceb4c78afac" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Creating volume 5a0e348c-68a1-4ab1-b330-dceb4c78afac from snapshot 35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-quobyte-5a0e348c-68a1-4ab1-b330-dceb4c78afac" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-8784703d-843a-4ece-bbdb-e9d39a66ec55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27f29732-6f70-46fc-b5f5-d89eeee9f9a5', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-5a0e348c-68a1-4ab1-b330-dceb4c78afac" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] snapshot: 35692e29-ccef-43ab-b508-b3744e6b4326, volume: 5a0e348c-68a1-4ab1-b330-dceb4c78afac, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0692b0ba-b273-43fa-a197-dce355d67f07]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-ff888c2d-4e0c-435d-815e-8464e146575e req-71492703-ee69-4a90-a534-d0ca79198b6d tempest-TestMinimumBasicScenario-880518633 None] attachment_update completed successfully. Jun 27 20:07:43 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 Jun 27 20:07:43 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:43 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 0 in 0.988s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:43 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:43 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:43 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326" returned: 0 in 1.033s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58fea45b-2d5d-4d14-af64-1a676d44e59e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d05bf-c179-4726-9363-8f8357ff96ff]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:44 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:07:44 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:44 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 1 in 0.898s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:07:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:44 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453 Jun 27 20:07:44 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:44 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 0.939s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:44 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:07:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:44 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac Jun 27 20:07:44 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:45 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-53bbb8ee-d19c-437e-ad86-352c13f66453" returned: 0 in 0.809s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-53bbb8ee-d19c-437e-ad86-352c13f66453" released by "delete_volume" :: held 2.816s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Created reservations ['ceb72554-acf2-429e-b7a8-f8ecb1cb7722', '83f9fc49-2494-45af-a804-50eb67fa8e53', 'c5403d70-d43c-40ef-85b4-1ccd8d067923', '4e3661da-702d-4a06-b510-4fd58771d88f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:45 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:07:45 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:47 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.572s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:07:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Deleted volume successfully. Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19650ee9-4b14-438d-b07b-68885c2247fe tempest-VolumesExtendTest-2073777421 None] Lock "cinder-53bbb8ee-d19c-437e-ad86-352c13f66453-delete_volume" released by "delete_volume" :: held 4.754s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Flow 'volume_create_manager' (b184220a-393d-4ca6-aa70-d14bcfe33241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ea1c2d-5da7-41a1-a9a8-e5c4c6227eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ea1c2d-5da7-41a1-a9a8-e5c4c6227eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-674023661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0f263a-3ec8-4b6a-b864-920e8b5eaa46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c57a40afd7c452b80c30b77faf3c121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:47Z,use_quota=True,user_id='dccce4d386534f83b1e5acd54600f31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad881cb-1b21-4c57-84fa-6e8d3901f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad881cb-1b21-4c57-84fa-6e8d3901f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9fa6a5-6c93-4deb-aff3-f9b999083986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9fa6a5-6c93-4deb-aff3-f9b999083986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0f263a-3ec8-4b6a-b864-920e8b5eaa46', 'volume_name': 'volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9619b799-4bd8-48f2-8c92-08eacf28dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9619b799-4bd8-48f2-8c92-08eacf28dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa65a573-1b71-4c63-aea5-28a9854fc474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:47 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Volume 1d0f263a-3ec8-4b6a-b864-920e8b5eaa46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46', 'volume_size': 1} Jun 27 20:07:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:51 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac" returned: 0 in 6.970s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a7f68-467e-4d6e-8bfd-19c50e190439]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:52 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:07:52 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:52 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 1.098s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:52 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:07:52 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Converted 1024.00 MB image at 146.88 MB/s Jun 27 20:07:52 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac is being set with open permissions: ugo+rw Jun 27 20:07:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:53 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac Jun 27 20:07:53 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:53 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac" returned: 0 in 0.755s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-5a0e348c-68a1-4ab1-b330-dceb4c78afac" released by "_copy_volume_from_snapshot" :: held 10.927s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-35692e29-ccef-43ab-b508-b3744e6b4326-5a0e348c-68a1-4ab1-b330-dceb4c78afac" released by "_create_volume_from_snapshot" :: held 10.966s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.093s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-674023661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0f263a-3ec8-4b6a-b864-920e8b5eaa46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c57a40afd7c452b80c30b77faf3c121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:07:47Z,use_quota=True,user_id='dccce4d386534f83b1e5acd54600f31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Creating volume 1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:07:53 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:53 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 1073741824 Jun 27 20:07:53 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b109a2-acbf-40c5-af50-7732da553d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac', 'volume_size': 1, 'snapshot_id': '35692e29-ccef-43ab-b508-b3744e6b4326'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd89e018-a99a-4c94-90e5-be7fbe93e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Volume volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac (5a0e348c-68a1-4ab1-b330-dceb4c78afac): created successfully Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd89e018-a99a-4c94-90e5-be7fbe93e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Flow 'volume_create_manager' (e8acf399-97f8-4207-a671-09d0c62510c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7eb82756-b082-4fa4-aed3-dbe9053b330d tempest-VolumeDependencyTests-564126909 None] Created volume successfully. Jun 27 20:07:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-35692e29-ccef-43ab-b508-b3744e6b4326-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Lock "cinder-35692e29-ccef-43ab-b508-b3744e6b4326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-quobyte-58fea45b-2d5d-4d14-af64-1a676d44e59e" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-58fea45b-2d5d-4d14-af64-1a676d44e59e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-quobyte-35692e29-ccef-43ab-b508-b3744e6b4326" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-35692e29-ccef-43ab-b508-b3744e6b4326" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Deleting offline snapshot 35692e29-ccef-43ab-b508-b3744e6b4326 of volume 58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] snapshot_file for this snap is: volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb950861-9ed9-40c4-ad76-74ddb52183f9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:55 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 Jun 27 20:07:55 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:55 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 1073741824" returned: 0 in 1.545s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:55 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 Jun 27 20:07:55 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:56 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326" returned: 0 in 1.093s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58fea45b-2d5d-4d14-af64-1a676d44e59e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bce7f1d-f14a-421d-a571-cc2608f44130]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:56 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" returned: 0 in 0.860s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] <== create_volume: return (2461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa65a573-1b71-4c63-aea5-28a9854fc474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c25aef9-a528-470d-ac53-cc64a7b954bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:07:56 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Volume volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 (1d0f263a-3ec8-4b6a-b864-920e8b5eaa46): created successfully Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c25aef9-a528-470d-ac53-cc64a7b954bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:07:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Flow 'volume_create_manager' (b184220a-393d-4ca6-aa70-d14bcfe33241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:07:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-421edbe7-0d39-459d-a524-9bf149d143d0 tempest-VolumesExtendTest-2073777421 None] Created volume successfully. Jun 27 20:07:56 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:07:56 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:57 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 0.846s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:57 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 Jun 27 20:07:57 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Creating offline snapshot 1691c483-52b9-41ee-bcf9-2795de43ac2b of volume 1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[019756fd-6a87-4b3c-9e99-9d3047d75fc5]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:07:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:57 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 Jun 27 20:07:57 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:58 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326" returned: 0 in 1.266s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:58 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326 Jun 27 20:07:58 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:58 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" returned: 0 in 1.033s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:58 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b 1G Jun 27 20:07:58 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:07:59 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e.35692e29-ccef-43ab-b508-b3744e6b4326" returned: 0 in 0.763s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-35692e29-ccef-43ab-b508-b3744e6b4326" released by "_delete_snapshot" :: held 4.112s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-58fea45b-2d5d-4d14-af64-1a676d44e59e" released by "delete_snapshot" :: held 4.164s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Created reservations ['9f80a0fc-b44c-40e2-84a6-4b05b6add96c', '615e1308-933d-4357-a31e-40a9cad8b428', 'fdcfdf3f-62e4-4353-8002-658b778aea6f', 'ff6a5025-611b-4c00-b08a-5528dc22a337'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:07:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Delete snapshot completed successfully. Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c2d328cd-f048-4639-8ecd-1b23a67e679c tempest-VolumeDependencyTests-564126909 None] Lock "cinder-35692e29-ccef-43ab-b508-b3744e6b4326-delete_snapshot" released by "delete_snapshot" :: held 4.383s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:07:59 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b 1G" returned: 0 in 0.928s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:07:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:07:59 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b Jun 27 20:07:59 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-58fea45b-2d5d-4d14-af64-1a676d44e59e-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Lock "cinder-58fea45b-2d5d-4d14-af64-1a676d44e59e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-quobyte-58fea45b-2d5d-4d14-af64-1a676d44e59e" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-58fea45b-2d5d-4d14-af64-1a676d44e59e" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dedef66-f924-4b3b-bc2f-7a6f5204a6c1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:00 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b" returned: 0 in 0.869s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:00 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b is being set with open permissions: ugo+rw Jun 27 20:08:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:00 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:08:00 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:00 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b Jun 27 20:08:00 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:01 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b" returned: 0 in 0.718s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:01 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 0.846s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:01 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e Jun 27 20:08:01 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:01 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info Jun 27 20:08:01 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:02 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-58fea45b-2d5d-4d14-af64-1a676d44e59e" returned: 0 in 0.889s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:02 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info" returned: 0 in 0.892s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:02 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info is being set with open permissions: ugo+rw Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-58fea45b-2d5d-4d14-af64-1a676d44e59e" released by "delete_volume" :: held 1.835s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:02 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info Jun 27 20:08:02 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Created reservations ['1bd2d9c6-72b4-42e4-90ac-b1a5eeddba46', '638f9fad-0502-4d44-bd66-89cef0babfd7', '2f2e448d-4f81-4a63-9208-9c48643d8f2d', '9a389699-4566-44fb-9c75-13eaa5bf0a3e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:02 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:02 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-5a0e348c-68a1-4ab1-b330-dceb4c78afac-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Lock "cinder-5a0e348c-68a1-4ab1-b330-dceb4c78afac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Acquiring lock "cinder-quobyte-5a0e348c-68a1-4ab1-b330-dceb4c78afac" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-5a0e348c-68a1-4ab1-b330-dceb4c78afac" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75af26-0c16-4f54-b57c-a957b9d1fa6e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:03 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac Jun 27 20:08:03 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:03 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.info" returned: 0 in 0.881s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.467s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d38425f1-6761-4f90-bed5-7ca0bfa598ff tempest-VolumesExtendTest-2073777421 None] Create snapshot completed successfully Jun 27 20:08:03 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.889s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Deleted volume successfully. Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1f716594-67c8-4296-aaff-610167818efc tempest-VolumeDependencyTests-564126909 None] Lock "cinder-58fea45b-2d5d-4d14-af64-1a676d44e59e-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:03 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac" returned: 0 in 0.979s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:03 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac Jun 27 20:08:03 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[698355b5-2f1c-477a-806b-0d34654b9976]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:04 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 Jun 27 20:08:04 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:04 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a0e348c-68a1-4ab1-b330-dceb4c78afac" returned: 0 in 0.920s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Lock "cinder-quobyte-5a0e348c-68a1-4ab1-b330-dceb4c78afac" released by "delete_volume" :: held 1.974s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:04 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Created reservations ['577b5e9d-692f-4996-923d-845d6ae17a57', '25027a23-554a-4859-8852-5e14a882e4a0', 'b6c23012-74ac-4a1f-882f-81ef250587d8', '66ce02c0-bdac-48e2-9aca-ccdc1be66fbe'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:05 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:05 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:05 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" returned: 0 in 1.044s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b 2G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b 2G" returned: 0 in 0.167s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.252s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7c41a532-99ed-4ab5-a79d-98f34da726c1 tempest-VolumesExtendTest-2073777421 None] Extend volume completed successfully. Jun 27 20:08:05 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.734s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Deleted volume successfully. Jun 27 20:08:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2be233a0-0a60-4e66-8524-f851f9a3d8eb tempest-VolumeDependencyTests-564126909 None] Lock "cinder-5a0e348c-68a1-4ab1-b330-dceb4c78afac-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-1691c483-52b9-41ee-bcf9-2795de43ac2b-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-1691c483-52b9-41ee-bcf9-2795de43ac2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-quobyte-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-quobyte-1691c483-52b9-41ee-bcf9-2795de43ac2b" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-1691c483-52b9-41ee-bcf9-2795de43ac2b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Deleting offline snapshot 1691c483-52b9-41ee-bcf9-2795de43ac2b of volume 1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] snapshot_file for this snap is: volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf99d9a-795e-4c4f-aa2d-0fd3e1b5974a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:07 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b Jun 27 20:08:07 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:08 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b" returned: 0 in 1.134s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:08:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb9410d-8f45-4602-94be-2eb3747447ba]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:08 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 Jun 27 20:08:08 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:09 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" returned: 0 in 1.128s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:09 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b Jun 27 20:08:09 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:10 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b" returned: 0 in 1.621s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:10 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b Jun 27 20:08:10 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:11 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46.1691c483-52b9-41ee-bcf9-2795de43ac2b" returned: 0 in 0.809s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-1691c483-52b9-41ee-bcf9-2795de43ac2b" released by "_delete_snapshot" :: held 4.898s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" released by "delete_snapshot" :: held 4.929s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:11 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Created reservations ['d6c7182f-9697-4380-b0bf-f3d3e1424dda', '88db2be7-de7d-4aa2-8f4f-9ca7f56dd3f6', '804d8c06-a4be-492d-9b27-38af3ca916f1', '29f6255d-ee7d-4de7-9f2f-ec362011b1ba'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Delete snapshot completed successfully. Jun 27 20:08:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-08b19641-e84d-41d6-ae37-c5cd9822f49e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-1691c483-52b9-41ee-bcf9-2795de43ac2b-delete_snapshot" released by "delete_snapshot" :: held 5.239s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Acquiring lock "cinder-quobyte-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:12 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c535dd5-5171-4cd0-8517-b93a3d4723a7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:12 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 Jun 27 20:08:12 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:13 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" returned: 0 in 0.929s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:13 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46 Jun 27 20:08:13 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:14 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" returned: 0 in 0.788s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-quobyte-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46" released by "delete_volume" :: held 1.792s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Created reservations ['94a32274-851f-4eda-bfa0-aefd6a00f4dd', '6ade1b40-d75a-4ec6-9038-368921e7ee3c', '4eef0b12-2277-4a5b-a54b-b27042b638d2', 'e8db2367-2d3d-42b4-874c-0b6f502b1fc1'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:14 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:14 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:15 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.870s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:15 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Deleted volume successfully. Jun 27 20:08:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e14ce54c-2fc9-4439-88af-e0cb4267c98e tempest-VolumesExtendTest-2073777421 None] Lock "cinder-1d0f263a-3ec8-4b6a-b864-920e8b5eaa46-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:16 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:16 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:17 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.974s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:08:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:08:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (52d954cf-b3e5-4ce8-84a4-035cf07fa5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4d1627-5866-4997-a491-7f081b03d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4d1627-5866-4997-a491-7f081b03d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1741792137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60b2a93-6a74-4c53-ab91-325f8e058743,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:19Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1e3ccd-4ce4-4436-8033-b8769515c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1e3ccd-4ce4-4436-8033-b8769515c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc621de-ca6e-42a4-8e94-815521adbc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc621de-ca6e-42a4-8e94-815521adbc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e60b2a93-6a74-4c53-ab91-325f8e058743', 'volume_name': 'volume-e60b2a93-6a74-4c53-ab91-325f8e058743', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8b0b70-345b-45fc-aeaa-9673887f34c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8b0b70-345b-45fc-aeaa-9673887f34c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d537559-3250-4c66-b3bb-f504a760cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:18 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Volume e60b2a93-6a74-4c53-ab91-325f8e058743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e60b2a93-6a74-4c53-ab91-325f8e058743', 'volume_size': 1} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1741792137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60b2a93-6a74-4c53-ab91-325f8e058743,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:19Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Creating volume e60b2a93-6a74-4c53-ab91-325f8e058743 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:08:18 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:08:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:18 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 1073741824 Jun 27 20:08:18 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:19 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 1073741824" returned: 0 in 1.008s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:19 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 Jun 27 20:08:19 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:20 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743" returned: 0 in 0.798s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d537559-3250-4c66-b3bb-f504a760cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60b2a93-6a74-4c53-ab91-325f8e058743', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8275940-1fe8-4471-a6ae-3f7ffb0b8d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:20 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Volume volume-e60b2a93-6a74-4c53-ab91-325f8e058743 (e60b2a93-6a74-4c53-ab91-325f8e058743): created successfully Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8275940-1fe8-4471-a6ae-3f7ffb0b8d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:20 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (52d954cf-b3e5-4ce8-84a4-035cf07fa5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bfe464b9-319a-42a5-9d2d-4aaef7cd80db tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (0c0f1c51-4181-4a46-97e6-8279d060d46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72215ff8-a26d-42c8-9afc-4060cbcc5168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72215ff8-a26d-42c8-9afc-4060cbcc5168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-373980751',display_name='tempest-VolumesGetTest-Volume-944453189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81dc18ed-6ad7-4412-b60c-e0448b65a1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:23Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07b65ea-8bb8-4dcc-ae8e-4741456df8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07b65ea-8bb8-4dcc-ae8e-4741456df8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce77156e-8ebb-492b-bcb5-864711463070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce77156e-8ebb-492b-bcb5-864711463070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81dc18ed-6ad7-4412-b60c-e0448b65a1e0', 'volume_name': 'volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67009d-83f9-44fb-958a-1f079413e030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67009d-83f9-44fb-958a-1f079413e030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86785773-4f3d-4866-86ce-d43cc94289b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:22 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Volume 81dc18ed-6ad7-4412-b60c-e0448b65a1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0', 'volume_size': 1} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-373980751',display_name='tempest-VolumesGetTest-Volume-944453189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81dc18ed-6ad7-4412-b60c-e0448b65a1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:23Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Creating volume 81dc18ed-6ad7-4412-b60c-e0448b65a1e0 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:08:22 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:08:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:22 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 1073741824 Jun 27 20:08:22 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:23 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 1073741824" returned: 0 in 0.980s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:23 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 Jun 27 20:08:23 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:24 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0" returned: 0 in 0.829s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86785773-4f3d-4866-86ce-d43cc94289b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35511f42-c42c-43f0-bd05-f2b96df33988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:24 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Volume volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 (81dc18ed-6ad7-4412-b60c-e0448b65a1e0): created successfully Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35511f42-c42c-43f0-bd05-f2b96df33988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (0c0f1c51-4181-4a46-97e6-8279d060d46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1a4516a5-61bd-4931-b857-6f2efa95c0bb tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Flow 'volume_create_manager' (e979f0a3-f3fa-4b4b-95ba-e016a55b0d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc62283-f6d7-467a-8551-f260e4f0fcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc62283-f6d7-467a-8551-f260e4f0fcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-252499152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f835299d-51e4-492a-a52c-5b9598753062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4c28bd5e5f4b1784013899536f16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:25Z,use_quota=True,user_id='fd06812ef5bb419fabb28fca06c7a4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492d3990-cedd-46da-a323-ee9a9d50bfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492d3990-cedd-46da-a323-ee9a9d50bfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13ce37b-0833-4b15-9da5-7db1553b5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13ce37b-0833-4b15-9da5-7db1553b5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f835299d-51e4-492a-a52c-5b9598753062', 'volume_name': 'volume-f835299d-51e4-492a-a52c-5b9598753062', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee1e8c9-e738-4224-812e-3faba92bdab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee1e8c9-e738-4224-812e-3faba92bdab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895b0641-d332-4ca0-935b-a4b3153735af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Volume f835299d-51e4-492a-a52c-5b9598753062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f835299d-51e4-492a-a52c-5b9598753062', 'volume_size': 1} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-252499152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f835299d-51e4-492a-a52c-5b9598753062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4c28bd5e5f4b1784013899536f16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:25Z,use_quota=True,user_id='fd06812ef5bb419fabb28fca06c7a4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Creating volume f835299d-51e4-492a-a52c-5b9598753062 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:08:25 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:25 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 1073741824 Jun 27 20:08:25 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Flow 'volume_create_manager' (0e42c007-a665-4cac-a65f-ef0143b1a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40771ce-4ec9-4347-a660-61ebd95f2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40771ce-4ec9-4347-a660-61ebd95f2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-978962919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850490b6-8d35-49ec-a9fd-39e02eba7784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4c28bd5e5f4b1784013899536f16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:26Z,use_quota=True,user_id='fd06812ef5bb419fabb28fca06c7a4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa907bd-3afa-426c-9c4c-79d91124f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa907bd-3afa-426c-9c4c-79d91124f486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a9b450-2f8d-4d7e-a610-85961bf216b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a9b450-2f8d-4d7e-a610-85961bf216b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850490b6-8d35-49ec-a9fd-39e02eba7784', 'volume_name': 'volume-850490b6-8d35-49ec-a9fd-39e02eba7784', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bf9e30-45b3-4a29-a909-109c30976d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bf9e30-45b3-4a29-a909-109c30976d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504aa754-6df3-485c-92f8-a0454b5ec2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:25 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Volume 850490b6-8d35-49ec-a9fd-39e02eba7784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850490b6-8d35-49ec-a9fd-39e02eba7784', 'volume_size': 1} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-81dc18ed-6ad7-4412-b60c-e0448b65a1e0-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Lock "cinder-81dc18ed-6ad7-4412-b60c-e0448b65a1e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-81dc18ed-6ad7-4412-b60c-e0448b65a1e0" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-81dc18ed-6ad7-4412-b60c-e0448b65a1e0" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7c25a-cda8-4b43-8c08-dcf3b2dfaf04]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:26 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 Jun 27 20:08:26 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:26 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 1073741824" returned: 0 in 1.002s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:26 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 Jun 27 20:08:26 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:26 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0" returned: 0 in 0.819s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:26 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0 Jun 27 20:08:26 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:27 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062" returned: 0 in 0.721s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-978962919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850490b6-8d35-49ec-a9fd-39e02eba7784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4c28bd5e5f4b1784013899536f16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:26Z,use_quota=True,user_id='fd06812ef5bb419fabb28fca06c7a4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Creating volume 850490b6-8d35-49ec-a9fd-39e02eba7784 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:08:27 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:27 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 1073741824 Jun 27 20:08:27 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895b0641-d332-4ca0-935b-a4b3153735af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f835299d-51e4-492a-a52c-5b9598753062', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff106d2-e117-423d-a1ea-d047010b59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:27 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Volume volume-f835299d-51e4-492a-a52c-5b9598753062 (f835299d-51e4-492a-a52c-5b9598753062): created successfully Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff106d2-e117-423d-a1ea-d047010b59ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Flow 'volume_create_manager' (e979f0a3-f3fa-4b4b-95ba-e016a55b0d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:27 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d38eb3d0-906a-4e40-8401-fd4d2df17756 tempest-TestServerVolumeAttachmentScenario-803889416 None] Created volume successfully. Jun 27 20:08:27 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-81dc18ed-6ad7-4412-b60c-e0448b65a1e0" returned: 0 in 0.757s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-81dc18ed-6ad7-4412-b60c-e0448b65a1e0" released by "delete_volume" :: held 1.633s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Created reservations ['028af14a-2f9d-445f-9d84-be5a59775f44', '31a2e5b3-9115-4747-a612-d772c67364dc', '4fb610a2-7653-4e4a-92fb-f238a1185f45', 'cb586928-0255-443b-9a13-46c2112dd0ab'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:27 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:27 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:28 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 1073741824" returned: 0 in 0.995s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:28 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 Jun 27 20:08:28 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-e60b2a93-6a74-4c53-ab91-325f8e058743-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Lock "cinder-e60b2a93-6a74-4c53-ab91-325f8e058743-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-e60b2a93-6a74-4c53-ab91-325f8e058743" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-e60b2a93-6a74-4c53-ab91-325f8e058743" acquired by "delete_volume" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd302bca-0e24-4e5e-83c6-0c91dde1296e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:28 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 Jun 27 20:08:28 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:28 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.846s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:08:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c8f0808d-af24-49e0-95f1-80749913ecdb tempest-VolumesGetTest-86149708 None] Lock "cinder-81dc18ed-6ad7-4412-b60c-e0448b65a1e0-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:28 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784" returned: 0 in 0.895s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504aa754-6df3-485c-92f8-a0454b5ec2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850490b6-8d35-49ec-a9fd-39e02eba7784', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27556ae-e4b6-446d-9f30-1c9bbc44ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:29 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Volume volume-850490b6-8d35-49ec-a9fd-39e02eba7784 (850490b6-8d35-49ec-a9fd-39e02eba7784): created successfully Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27556ae-e4b6-446d-9f30-1c9bbc44ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Flow 'volume_create_manager' (0e42c007-a665-4cac-a65f-ef0143b1a82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:29 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ac150c7c-011e-46d6-8416-be114c1a2116 tempest-TestServerVolumeAttachmentScenario-803889416 None] Created volume successfully. Jun 27 20:08:29 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743" returned: 0 in 0.902s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:29 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743 Jun 27 20:08:29 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:30 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e60b2a93-6a74-4c53-ab91-325f8e058743" returned: 0 in 0.694s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-e60b2a93-6a74-4c53-ab91-325f8e058743" released by "delete_volume" :: held 1.657s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Created reservations ['6938c1d9-b918-4fc6-8456-1c7e7e41550b', '5ded77d4-3338-4dd8-b888-9975c992b5f4', 'fbbea538-46c2-4a42-b390-82a981fe953d', 'ea7a1e78-658c-4def-b432-0bb4ab0dd81b'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:30 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:30 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:31 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-23ff3685-2e23-42e4-a0f7-1fa1b10d682e tempest-VolumesGetTest-86149708 None] Lock "cinder-e60b2a93-6a74-4c53-ab91-325f8e058743-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (b72f414f-a616-4912-838e-328708c855e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ba0469-6bfe-4314-9420-a91a510accf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ba0469-6bfe-4314-9420-a91a510accf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1911424459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:31Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e14ff2-75ea-477c-8261-0c86a8b90b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e14ff2-75ea-477c-8261-0c86a8b90b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57846e75-ece7-492f-bdea-e8e61a247398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57846e75-ece7-492f-bdea-e8e61a247398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'volume_name': 'volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35bdef2-a1da-47c4-8722-5a72e0f994cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35bdef2-a1da-47c4-8722-5a72e0f994cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90611dd0-b06c-41bd-9bf5-cfff7eb385ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:31 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Volume 8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'volume_size': 1} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1911424459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:31Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Creating volume 8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:08:31 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:08:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:31 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 1073741824 Jun 27 20:08:31 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:32 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 1073741824" returned: 0 in 0.963s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:32 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:08:32 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:32 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 0.673s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90611dd0-b06c-41bd-9bf5-cfff7eb385ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89de79b-fa64-4f41-a2dc-16dab2de0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:32 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Volume volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 (8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28): created successfully Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89de79b-fa64-4f41-a2dc-16dab2de0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (b72f414f-a616-4912-838e-328708c855e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:32 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7407435d-8f00-4175-8a35-b68298fb3a4d tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (d28521e0-e99c-4bfe-9e6d-774a4b4f1b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6c2712-d64c-44de-b448-34e5d15ccf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6c2712-d64c-44de-b448-34e5d15ccf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-763727872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eccecf4-fa6f-4892-b49b-efa9000d3820,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:34Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbac1ba0-95c5-41e4-a9d9-62037cce05bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbac1ba0-95c5-41e4-a9d9-62037cce05bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a106dbe-0381-40af-a49e-3750ab528f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a106dbe-0381-40af-a49e-3750ab528f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7eccecf4-fa6f-4892-b49b-efa9000d3820', 'volume_name': 'volume-7eccecf4-fa6f-4892-b49b-efa9000d3820', 'volume_size': 1, 'source_volid': '8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'source_volstatus': 'available'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbeea970-0145-4fec-b138-6b0e1595f3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbeea970-0145-4fec-b138-6b0e1595f3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace18288-cd9e-476d-b39e-81eba261b66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:33 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Volume 7eccecf4-fa6f-4892-b49b-efa9000d3820: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7eccecf4-fa6f-4892-b49b-efa9000d3820', 'volume_size': 1, 'source_volid': '8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'source_volstatus': 'available'} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:33 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Cloning volume 8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 to volume 7eccecf4-fa6f-4892-b49b-efa9000d3820 Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Creating offline snapshot 91e2a3fc-b267-411b-bf87-ea2ef27a5c80 of volume 8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921a88b-2253-42d7-acb9-70f136faa9c2]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:34 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:08:34 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:34 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 0.914s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:34 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 1G Jun 27 20:08:34 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:36 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 1G" returned: 0 in 1.200s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:36 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 Jun 27 20:08:36 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:36 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80" returned: 0 in 0.809s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:36 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 is being set with open permissions: ugo+rw Jun 27 20:08:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:36 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 Jun 27 20:08:36 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:37 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:37 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info Jun 27 20:08:37 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:38 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info" returned: 0 in 0.748s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:38 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info is being set with open permissions: ugo+rw Jun 27 20:08:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:38 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info Jun 27 20:08:38 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-a2b0182f-469f-4b19-924c-3b4081af78fe req-34791b3d-6f5d-4a7e-bbf7-bd71bdcbb270 tempest-TestMinimumBasicScenario-880518633 None] Terminate volume connection completed successfully. Jun 27 20:08:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-a2b0182f-469f-4b19-924c-3b4081af78fe req-34791b3d-6f5d-4a7e-bbf7-bd71bdcbb270 tempest-TestMinimumBasicScenario-880518633 None] Deleting attachment 27f29732-6f70-46fc-b5f5-d89eeee9f9a5. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:08:38 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.info" returned: 0 in 0.694s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-7eccecf4-fa6f-4892-b49b-efa9000d3820" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-7eccecf4-fa6f-4892-b49b-efa9000d3820" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] snapshot: 91e2a3fc-b267-411b-bf87-ea2ef27a5c80, volume: 7eccecf4-fa6f-4892-b49b-efa9000d3820, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7501bdae-dece-40ef-af64-3e0d646c9c6c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:39 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 Jun 27 20:08:39 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:39 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80" returned: 0 in 0.775s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a63859-049d-4a8e-8c21-4902000bddbf]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:39 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:08:39 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Acquiring lock "cinder-8784703d-843a-4ece-bbdb-e9d39a66ec55-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Lock "cinder-8784703d-843a-4ece-bbdb-e9d39a66ec55-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:DELETE=9,cinder:UPDATE=91,cinder:SELECT=70,cinder:INSERT=21 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=76,cinder:UPDATE=88,cinder:INSERT=20,cinder:DELETE=6 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Acquiring lock "cinder-quobyte-8784703d-843a-4ece-bbdb-e9d39a66ec55" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Lock "cinder-quobyte-8784703d-843a-4ece-bbdb-e9d39a66ec55" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2185a94a-8513-4a02-98b8-90c040d9c801]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:40 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 Jun 27 20:08:40 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:40 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 0.786s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:08:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:40 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 Jun 27 20:08:40 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:41 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55" returned: 0 in 1.111s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:41 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55 Jun 27 20:08:41 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:44 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8784703d-843a-4ece-bbdb-e9d39a66ec55" returned: 0 in 2.515s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Lock "cinder-quobyte-8784703d-843a-4ece-bbdb-e9d39a66ec55" released by "delete_volume" :: held 3.718s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Created reservations ['aa403c4e-13e3-47b8-becc-92f78624be61', '6a589981-ab9b-4d1c-9975-4f7d03f935ca', 'f11d5a13-89c7-430f-8748-1bebb15f5f65', '68ac31f1-cd0e-4eee-8567-3703f82848bb'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:44 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:44 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:47 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 2.959s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:47 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:08:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Deleted volume successfully. Jun 27 20:08:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a896e02-8368-41ef-ba67-8cb80ca6ed0e tempest-TestMinimumBasicScenario-880518633 None] Lock "cinder-8784703d-843a-4ece-bbdb-e9d39a66ec55-delete_volume" released by "delete_volume" :: held 7.203s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:49 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820" returned: 0 in 8.761s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb754605-2357-4759-8c62-f331d915eee7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:49 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:08:49 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:50 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 1.311s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:50 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:08:50 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Converted 1024.00 MB image at 116.87 MB/s Jun 27 20:08:50 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 is being set with open permissions: ugo+rw Jun 27 20:08:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:50 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 Jun 27 20:08:50 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:51 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820" returned: 0 in 0.676s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-7eccecf4-fa6f-4892-b49b-efa9000d3820" released by "_copy_volume_from_snapshot" :: held 12.399s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-91e2a3fc-b267-411b-bf87-ea2ef27a5c80" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-91e2a3fc-b267-411b-bf87-ea2ef27a5c80" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Deleting offline snapshot 91e2a3fc-b267-411b-bf87-ea2ef27a5c80 of volume 8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] snapshot_file for this snap is: volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a6c15-16a4-41ee-8652-f8b6f67a1a37]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:51 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 Jun 27 20:08:51 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:52 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80" returned: 0 in 0.806s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:52 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:08:52 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf7ccb-e224-4cd5-ba6f-7cb2334f1a44]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:52 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:08:52 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:53 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 0.826s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:53 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 Jun 27 20:08:53 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:53 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80" returned: 0 in 0.757s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:53 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80 Jun 27 20:08:53 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:54 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28.91e2a3fc-b267-411b-bf87-ea2ef27a5c80" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-91e2a3fc-b267-411b-bf87-ea2ef27a5c80" released by "_delete_snapshot" :: held 3.188s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.840s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace18288-cd9e-476d-b39e-81eba261b66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eccecf4-fa6f-4892-b49b-efa9000d3820', 'volume_size': 1, 'source_volid': '8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28', 'source_volstatus': 'available'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52f5fb-23a4-40a0-8960-45a8af97dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:54 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Volume volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 (7eccecf4-fa6f-4892-b49b-efa9000d3820): created successfully Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52f5fb-23a4-40a0-8960-45a8af97dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (d28521e0-e99c-4bfe-9e6d-774a4b4f1b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1c7caf64-cc56-4cbc-84ae-7c354b05597f tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (365677a0-15a7-461d-a934-29b8fd0f53b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f304ec9-0719-4b8b-88f9-8061f6f3fd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f304ec9-0719-4b8b-88f9-8061f6f3fd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2143584555',display_name='tempest-VolumesGetTest-Volume-2038593862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7167ddd-8ae8-456f-9c84-9fa8089ecb39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:56Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169fc713-4a03-4c20-a272-acc70c305dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169fc713-4a03-4c20-a272-acc70c305dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6962b56-345c-440b-8036-b175d6c84154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6962b56-345c-440b-8036-b175d6c84154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7167ddd-8ae8-456f-9c84-9fa8089ecb39', 'volume_name': 'volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fe9aed-82d8-415a-88e7-e859715a5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fe9aed-82d8-415a-88e7-e859715a5201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d036b1d8-c6a3-428a-ba86-65640e9f5a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:56 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Volume e7167ddd-8ae8-456f-9c84-9fa8089ecb39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39', 'volume_size': 1} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:08:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2143584555',display_name='tempest-VolumesGetTest-Volume-2038593862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7167ddd-8ae8-456f-9c84-9fa8089ecb39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:08:56Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Creating volume e7167ddd-8ae8-456f-9c84-9fa8089ecb39 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:08:56 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:08:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:56 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 1073741824 Jun 27 20:08:56 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:57 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 1073741824" returned: 0 in 0.909s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:57 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 Jun 27 20:08:57 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:57 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39" returned: 0 in 0.667s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d036b1d8-c6a3-428a-ba86-65640e9f5a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c372c-3114-418b-bef4-eac73152edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:08:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Volume volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 (e7167ddd-8ae8-456f-9c84-9fa8089ecb39): created successfully Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c372c-3114-418b-bef4-eac73152edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:08:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (365677a0-15a7-461d-a934-29b8fd0f53b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:08:57 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-137893a1-ca6c-4f8b-b224-1984fb72a9b8 tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:08:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-e7167ddd-8ae8-456f-9c84-9fa8089ecb39-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Lock "cinder-e7167ddd-8ae8-456f-9c84-9fa8089ecb39-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-e7167ddd-8ae8-456f-9c84-9fa8089ecb39" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:08:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-e7167ddd-8ae8-456f-9c84-9fa8089ecb39" acquired by "delete_volume" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:08:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c14bc-b05b-4147-a21c-14646cdb274d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:08:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:58 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 Jun 27 20:08:58 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:59 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39" returned: 0 in 0.792s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:59 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39 Jun 27 20:08:59 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:08:59 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e7167ddd-8ae8-456f-9c84-9fa8089ecb39" returned: 0 in 0.690s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-e7167ddd-8ae8-456f-9c84-9fa8089ecb39" released by "delete_volume" :: held 1.530s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Created reservations ['4289d110-7f8f-482d-8da3-a0446f52d7c5', '4905bebf-aed9-41d8-b364-02a104e28c27', '5e2461ac-0b91-46d3-a20a-192d6f769664', 'dfa5f64a-50e3-43be-9c04-c8966754a15e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:08:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:08:59 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:08:59 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-7eccecf4-fa6f-4892-b49b-efa9000d3820-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Lock "cinder-7eccecf4-fa6f-4892-b49b-efa9000d3820-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-7eccecf4-fa6f-4892-b49b-efa9000d3820" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:00 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.741s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-7eccecf4-fa6f-4892-b49b-efa9000d3820" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbbc7ba-c1c2-4b85-a687-4797653dc952]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d99f2fa8-9497-458e-b49d-1a33b501b4d7 tempest-VolumesGetTest-86149708 None] Lock "cinder-e7167ddd-8ae8-456f-9c84-9fa8089ecb39-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:00 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 Jun 27 20:09:00 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:01 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820" returned: 0 in 0.805s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:01 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820 Jun 27 20:09:01 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:02 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-7eccecf4-fa6f-4892-b49b-efa9000d3820" returned: 0 in 0.677s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-7eccecf4-fa6f-4892-b49b-efa9000d3820" released by "delete_volume" :: held 1.544s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Created reservations ['4c2cfc68-1fd6-4c3b-aff1-6ffc04f10bf2', 'df775657-95c2-46cb-b086-901b75718521', '1eb94394-842f-48dc-b5e8-77e6a1fd3f80', '6bfb0a0b-e035-4352-809e-ccffd757a771'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:02 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:02 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Lock "cinder-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d9324-88e4-408b-a2e6-81b88f3fb79a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:03 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.880s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:09:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6f7fcff9-d364-4bd1-9275-3da309aac5fa tempest-VolumesGetTest-86149708 None] Lock "cinder-7eccecf4-fa6f-4892-b49b-efa9000d3820-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:03 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:09:03 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:04 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 0.862s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:04 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28 Jun 27 20:09:04 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:04 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" returned: 0 in 0.730s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28" released by "delete_volume" :: held 1.704s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Created reservations ['f00289bc-04ff-4114-a24f-d23e3848d6f3', '250fea96-7c12-4a99-84a7-2aaa2689934f', 'a0975e50-158e-45b1-aaa6-129f52c4891b', 'd7b14a01-ca40-4fdb-bd52-a1863d145457'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (44e99f9d-51b9-42bf-abce-ea71d8c60b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42f5af5-f126-4fb7-a61b-2062d4a6418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42f5af5-f126-4fb7-a61b-2062d4a6418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-846524389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f460b095-d55c-4074-a2ac-e71888d7f53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:05Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e1b4ea-0d6e-4c09-80c2-2a5ffc25947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e1b4ea-0d6e-4c09-80c2-2a5ffc25947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf3234a-f8bd-4210-9efe-91e5acbbcc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf3234a-f8bd-4210-9efe-91e5acbbcc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f460b095-d55c-4074-a2ac-e71888d7f53c', 'volume_name': 'volume-f460b095-d55c-4074-a2ac-e71888d7f53c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89add556-198a-4a44-b366-a5af1a1c3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89add556-198a-4a44-b366-a5af1a1c3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e40b36-18ad-4e1e-ac83-19ba6d49af66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:04 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Volume f460b095-d55c-4074-a2ac-e71888d7f53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f460b095-d55c-4074-a2ac-e71888d7f53c', 'volume_size': 1} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-846524389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f460b095-d55c-4074-a2ac-e71888d7f53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:05Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Creating volume f460b095-d55c-4074-a2ac-e71888d7f53c {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:05 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:05 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c 1073741824 Jun 27 20:09:05 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:05 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:05 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (bc9a09ef-e4cc-4613-a71c-3e57a3b3e1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17076638-6398-4331-84c1-ed63fbcd36ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17076638-6398-4331-84c1-ed63fbcd36ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-555447500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708fa957-b7bb-4330-88b3-fb8cc00070e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:05Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850fe244-71ce-4b7d-a795-48a670035732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850fe244-71ce-4b7d-a795-48a670035732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e6dd5f-4f86-4f06-b214-3bd06a5d9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e6dd5f-4f86-4f06-b214-3bd06a5d9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708fa957-b7bb-4330-88b3-fb8cc00070e7', 'volume_name': 'volume-708fa957-b7bb-4330-88b3-fb8cc00070e7', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dca3ae-dfd9-4d25-9afc-dc444fed02bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dca3ae-dfd9-4d25-9afc-dc444fed02bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181cb96-149e-47f1-8e77-3fe756894d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Volume 708fa957-b7bb-4330-88b3-fb8cc00070e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708fa957-b7bb-4330-88b3-fb8cc00070e7', 'volume_size': 1} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (187d5d4d-d083-4593-93b3-2adddad609b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec58f2-3b0c-4f4c-bf21-8bf441a43963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec58f2-3b0c-4f4c-bf21-8bf441a43963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651625635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4314e080-4bde-4280-9b4a-846d5f4a9ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:06Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a436b2e2-aad6-4124-a58a-3718c6d2bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a436b2e2-aad6-4124-a58a-3718c6d2bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f9f879-aff4-46a1-aec2-396fa98ade7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f9f879-aff4-46a1-aec2-396fa98ade7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4314e080-4bde-4280-9b4a-846d5f4a9ba8', 'volume_name': 'volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891a21e4-b834-4f2c-8a75-2421030b5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891a21e4-b834-4f2c-8a75-2421030b5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dff3b6a-f725-4387-918a-e2dfda06c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Volume 4314e080-4bde-4280-9b4a-846d5f4a9ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8', 'volume_size': 1} Jun 27 20:09:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:06 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.983s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-060f1312-3ea0-4f08-a7cf-59cba24c7d4f tempest-VolumesGetTest-86149708 None] Lock "cinder-8a75c170-abaa-4ed3-bdf6-d1ca3ee40d28-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:06 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c 1073741824" returned: 0 in 1.110s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:06 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c Jun 27 20:09:06 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (379cf708-4c7d-4227-aff2-82d8ab7d8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abbbd9c-cc16-45a1-aafd-c65c34f061bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abbbd9c-cc16-45a1-aafd-c65c34f061bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161755949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e2ad53-6835-4b6e-982d-d064a54cbd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:06Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141b8f35-17bf-46a3-8be9-657e88fe543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141b8f35-17bf-46a3-8be9-657e88fe543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4327865-c877-4159-8635-30a65d75448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4327865-c877-4159-8635-30a65d75448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e2ad53-6835-4b6e-982d-d064a54cbd90', 'volume_name': 'volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e37aed-16c0-435e-8ea4-a33d98dc88d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e37aed-16c0-435e-8ea4-a33d98dc88d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559353ce-bd36-45d9-ba56-9583b585c173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Volume e8e2ad53-6835-4b6e-982d-d064a54cbd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90', 'volume_size': 1} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (8dcb308e-1ca0-4097-8650-b9cfe856b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a8864c-a3c6-478f-8d2a-3da838e6ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a8864c-a3c6-478f-8d2a-3da838e6ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1489332595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a15a3fe-7241-48cb-9fc1-b900ae85d375,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:07Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce54f22f-4125-47d5-acf1-8895c9eabb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce54f22f-4125-47d5-acf1-8895c9eabb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a1ee6b-bc8b-4497-ad40-79475315a676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (7c3b2104-aaae-4667-aef3-58002fcd14fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0073a35-b71a-42f0-8f47-a9849b206f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0073a35-b71a-42f0-8f47-a9849b206f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115331404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:07Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe417e3-9e41-438a-ae8b-7f967ff6a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe417e3-9e41-438a-ae8b-7f967ff6a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4089245-9c84-474a-946c-473d6a3073f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4089245-9c84-474a-946c-473d6a3073f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75', 'volume_name': 'volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b739f44-9cd8-481e-be37-56c7149015b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b739f44-9cd8-481e-be37-56c7149015b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fde8365-9569-4315-b69b-459f5cb0c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Volume 92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75', 'volume_size': 1} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:06 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c" returned: 0 in 0.766s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-555447500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708fa957-b7bb-4330-88b3-fb8cc00070e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:05Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Creating volume 708fa957-b7bb-4330-88b3-fb8cc00070e7 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:06 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:06 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 1073741824 Jun 27 20:09:06 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e40b36-18ad-4e1e-ac83-19ba6d49af66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f460b095-d55c-4074-a2ac-e71888d7f53c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2609d23-be1f-428e-9f01-ec566fb74657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:06 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Volume volume-f460b095-d55c-4074-a2ac-e71888d7f53c (f460b095-d55c-4074-a2ac-e71888d7f53c): created successfully Jun 27 20:09:06 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2609d23-be1f-428e-9f01-ec566fb74657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (44e99f9d-51b9-42bf-abce-ea71d8c60b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-11d10744-33d2-4b4b-8983-b302ec5cbaeb tempest-CreateVolumesFromImageTest-377691049 None] Created volume successfully. Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a1ee6b-bc8b-4497-ad40-79475315a676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a15a3fe-7241-48cb-9fc1-b900ae85d375', 'volume_name': 'volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bb8eb6-8a8b-4b85-9c4f-eec842f43158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bb8eb6-8a8b-4b85-9c4f-eec842f43158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8067fbad-4faf-4404-86d6-556a287eb4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Volume 5a15a3fe-7241-48cb-9fc1-b900ae85d375: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Trying to clone 5a15a3fe-7241-48cb-9fc1-b900ae85d375 from image 45e3a23f-5037-4170-820b-7e6bcfe7854f at location (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:09:07 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Image download 20.69 MB at 20.69 MB/s Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f234e5-6040-4ac9-8329-97c386ef29a3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:07 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD Jun 27 20:09:07 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:07 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 1073741824" returned: 0 in 0.932s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:07 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 Jun 27 20:09:07 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:08 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f is fetched for user d1bed7f354b44398b69c54e6504b3431. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b58c9ba-a88f-4abe-890d-c0bc23dc8bf1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:08 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD Jun 27 20:09:08 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:08 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7" returned: 0 in 0.682s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651625635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4314e080-4bde-4280-9b4a-846d5f4a9ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:06Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Creating volume 4314e080-4bde-4280-9b4a-846d5f4a9ba8 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:08 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181cb96-149e-47f1-8e77-3fe756894d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708fa957-b7bb-4330-88b3-fb8cc00070e7', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:08 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 1073741824 Jun 27 20:09:08 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2ea9d9-bab7-4140-8e1b-2d324865baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:08 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Volume volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 (708fa957-b7bb-4330-88b3-fb8cc00070e7): created successfully Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2ea9d9-bab7-4140-8e1b-2d324865baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:08 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (bc9a09ef-e4cc-4613-a71c-3e57a3b3e1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:08 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-554f21bb-e748-49b9-a123-1807851f70f3 tempest-CreateVolumesFromImageTest-377691049 None] Created volume successfully. Jun 27 20:09:09 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:09 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 1073741824" returned: 0 in 0.859s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:09 devstack sudo[109912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 Jun 27 20:09:09 devstack sudo[109912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:10 devstack sudo[109912]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.518s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161755949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e2ad53-6835-4b6e-982d-d064a54cbd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:06Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Creating volume e8e2ad53-6835-4b6e-982d-d064a54cbd90 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:10 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dff3b6a-f725-4387-918a-e2dfda06c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:10 devstack sudo[109917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 1073741824 Jun 27 20:09:10 devstack sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f547f-92eb-4fb4-bcea-d0b98ad9247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:10 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Volume volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 (4314e080-4bde-4280-9b4a-846d5f4a9ba8): created successfully Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f547f-92eb-4fb4-bcea-d0b98ad9247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:10 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (187d5d4d-d083-4593-93b3-2adddad609b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:10 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3cb7587d-d85f-48d1-a13e-0d9c784d4337 tempest-CreateVolumesFromImageTest-377691049 None] Created volume successfully. Jun 27 20:09:11 devstack sudo[109917]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 1073741824" returned: 0 in 0.878s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:11 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 Jun 27 20:09:11 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:11 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90" returned: 0 in 0.657s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.856s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115331404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219f176f92cc42da98c8b3360e1716b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:07Z,use_quota=True,user_id='c30d6b08afc849bab13c6bda8e119776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Creating volume 92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:11 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:11 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 1073741824 Jun 27 20:09:11 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559353ce-bd36-45d9-ba56-9583b585c173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a106b795-d042-49ed-9c3e-d3b6410adc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Volume volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 (e8e2ad53-6835-4b6e-982d-d064a54cbd90): created successfully Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a106b795-d042-49ed-9c3e-d3b6410adc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (379cf708-4c7d-4227-aff2-82d8ab7d8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dd26a141-80a2-4de9-bdbb-13b58b9efc13 tempest-CreateVolumesFromImageTest-377691049 None] Created volume successfully. Jun 27 20:09:12 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 1073741824" returned: 0 in 0.850s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:12 devstack sudo[109934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 Jun 27 20:09:12 devstack sudo[109934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:13 devstack sudo[109934]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75" returned: 0 in 0.667s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.218s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1489332595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a15a3fe-7241-48cb-9fc1-b900ae85d375,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:07Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Creating volume 5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:13 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fde8365-9569-4315-b69b-459f5cb0c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:13 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 1073741824 Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22192be2-3cf1-4d2c-a160-92bccca73c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:13 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:13 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Volume volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 (92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75): created successfully Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22192be2-3cf1-4d2c-a160-92bccca73c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Flow 'volume_create_manager' (7c3b2104-aaae-4667-aef3-58002fcd14fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-08b7c90b-28ab-46fa-ad1d-fb5708b2fb06 tempest-CreateVolumesFromImageTest-377691049 None] Created volume successfully. Jun 27 20:09:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:14 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 1073741824" returned: 0 in 0.824s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:14 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:14 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-quobyte-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75" acquired by "delete_volume" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cae19e-51ea-468d-82f6-7b9d72926798]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:14 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 Jun 27 20:09:14 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:14 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 0 in 0.672s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.209s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e451439-e7b2-41e9-aa6e-6ce1b6241691]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Attempting download of 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 5a15a3fe-7241-48cb-9fc1-b900ae85d375. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d0bb82-ee23-4893-9782-12eadb348738]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:15 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 Jun 27 20:09:15 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:15 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea Jun 27 20:09:15 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:15 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75" returned: 0 in 0.769s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:15 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75 Jun 27 20:09:15 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:15 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-f835299d-51e4-492a-a52c-5b9598753062', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae949a7f-ec44-4cdb-bb4c-8527ea622cb1', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:09:15 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-a9879448-ecdc-49a4-bbe3-4529a54b1838 req-b2252c75-d160-4668-8122-4507c187235f tempest-TestServerVolumeAttachmentScenario-803889416 None] attachment_update completed successfully. Jun 27 20:09:15 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea Jun 27 20:09:15 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:15 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75" returned: 0 in 0.704s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75" released by "delete_volume" :: held 1.513s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Created reservations ['9e702c13-75c9-4d5b-a658-716a55aa9ffe', '0df5f07f-22fc-4b40-913c-1e5dcee6d0b6', 'b4dd665e-3848-4e27-a039-6337cbf26ca9', '8cbeaae7-9905-4cc4-85fd-b82f3fcbb792'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:16 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:16 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:16 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:16 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:16 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea" returned: 1 in 0.811s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_j8ncl8ea' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef72c35-2ee5-44e6-ad69-023b0c115ed7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-e8e2ad53-6835-4b6e-982d-d064a54cbd90-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-e8e2ad53-6835-4b6e-982d-d064a54cbd90-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-quobyte-e8e2ad53-6835-4b6e-982d-d064a54cbd90" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:16 devstack sudo[110047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD Jun 27 20:09:16 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-e8e2ad53-6835-4b6e-982d-d064a54cbd90" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb60f6e1-7540-4682-842b-ec018944cfdd]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:16 devstack sudo[110050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 Jun 27 20:09:16 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:16 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.836s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:16 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Deleted volume successfully. Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-19f66f63-4707-46ec-9954-4aad858c8475 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-92fc4d0f-d3d9-4c9a-8bbc-9abd49242e75-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:17 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.788s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:09:17 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] 45e3a23f-5037-4170-820b-7e6bcfe7854f was qcow2, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:17 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:17 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:17 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90" returned: 0 in 0.900s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:17 devstack sudo[110379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90 Jun 27 20:09:17 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:18 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e8e2ad53-6835-4b6e-982d-d064a54cbd90" returned: 0 in 0.762s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-e8e2ad53-6835-4b6e-982d-d064a54cbd90" released by "delete_volume" :: held 1.718s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Created reservations ['80a4a701-0259-45a4-9468-99a6415e8980', '66b600be-e5da-45ec-9625-05654be8b35b', 'c6a9ed48-574a-43ca-b5f7-9e7cd8e9cf9c', '3be5f112-7811-45e8-94d1-ce3f539e185a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:18 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:18 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-4314e080-4bde-4280-9b4a-846d5f4a9ba8-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-4314e080-4bde-4280-9b4a-846d5f4a9ba8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-quobyte-4314e080-4bde-4280-9b4a-846d5f4a9ba8" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-4314e080-4bde-4280-9b4a-846d5f4a9ba8" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb383d4-ce80-4171-81eb-aa00edc09c4d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:19 devstack sudo[110397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 Jun 27 20:09:19 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:19 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.749s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Deleted volume successfully. Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d91a30d8-1c26-4413-9263-a2fd258a7617 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-e8e2ad53-6835-4b6e-982d-d064a54cbd90-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:19 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 0 in 2.014s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_szqs3_ofdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:09:19 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Converted 112.00 MB image at 55.59 MB/s Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:19 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 1G Jun 27 20:09:19 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:19 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8" returned: 0 in 0.836s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:19 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8 Jun 27 20:09:19 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:20 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 1G" returned: 0 in 0.755s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f510fc-451e-418d-8214-b743c96221f0]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:20 devstack sudo[110410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:20 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:20 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4314e080-4bde-4280-9b4a-846d5f4a9ba8" returned: 0 in 0.703s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-4314e080-4bde-4280-9b4a-846d5f4a9ba8" released by "delete_volume" :: held 1.584s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Created reservations ['db29a7fb-aab8-4d6d-9e96-31e23b76581f', 'ee7a6a3b-5870-4a74-8cac-066644b701f3', '6229fe9e-7783-48df-8ce4-1715383652d1', '1ed9c481-21fb-4275-91d0-bbaafc34a632'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:20 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:20 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:21 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-708fa957-b7bb-4330-88b3-fb8cc00070e7-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:21 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-708fa957-b7bb-4330-88b3-fb8cc00070e7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:21 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-quobyte-708fa957-b7bb-4330-88b3-fb8cc00070e7" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-708fa957-b7bb-4330-88b3-fb8cc00070e7" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a78b67-b626-457c-8df2-a6877fdf6d9d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:21 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.720s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:21 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Deleted volume successfully. Jun 27 20:09:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-55c87382-acb8-4531-b87d-5d2035295fc3 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-4314e080-4bde-4280-9b4a-846d5f4a9ba8-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:21 devstack sudo[110421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 Jun 27 20:09:21 devstack sudo[110421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:22 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 1 in 0.911s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Downloaded image 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 5a15a3fe-7241-48cb-9fc1-b900ae85d375 successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f for user d1bed7f354b44398b69c54e6504b3431 is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Marking volume 5a15a3fe-7241-48cb-9fc1-b900ae85d375 as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Copying metadata from image 45e3a23f-5037-4170-820b-7e6bcfe7854f to 5a15a3fe-7241-48cb-9fc1-b900ae85d375. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Creating volume glance metadata for volume 5a15a3fe-7241-48cb-9fc1-b900ae85d375 backed by image 45e3a23f-5037-4170-820b-7e6bcfe7854f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8067fbad-4faf-4404-86d6-556a287eb4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc07649b-4179-4c90-9690-4a415b63d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:22 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Volume volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 (5a15a3fe-7241-48cb-9fc1-b900ae85d375): created successfully Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc07649b-4179-4c90-9690-4a415b63d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (8dcb308e-1ca0-4097-8650-b9cfe856b854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:22 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9130e1b3-625b-46c6-aeeb-d22162824004 tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:09:22 devstack sudo[110421]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7" returned: 0 in 0.869s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:22 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7 Jun 27 20:09:22 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:22 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-708fa957-b7bb-4330-88b3-fb8cc00070e7" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-708fa957-b7bb-4330-88b3-fb8cc00070e7" released by "delete_volume" :: held 1.660s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Created reservations ['f26a788e-3753-4dcf-a847-4200e266a1cc', '8d9b15a3-fa26-4f53-b742-68ba2be2aa23', '567fd141-f843-42ca-8cc5-e8d8897d7178', '1f7c026b-b1bd-4ad9-993d-efec3a09b3aa'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:23 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:23 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (4501b234-6523-4f54-87fb-e00ed557bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3097f7-f2f2-413c-93da-27cc7722ec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3097f7-f2f2-413c-93da-27cc7722ec13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1939328838',display_name='tempest-VolumesGetTest-Volume-1143418727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:23Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f0d177-e391-4a7f-8470-a8b7550fd888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f0d177-e391-4a7f-8470-a8b7550fd888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2587bc9-a86c-4183-8253-e71da68f4fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2587bc9-a86c-4183-8253-e71da68f4fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84', 'volume_name': 'volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b2df05-314c-4929-bdc6-7953b62b2c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b2df05-314c-4929-bdc6-7953b62b2c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5123c39e-c496-4ed8-9432-37bd7e37e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:23 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Volume b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84', 'volume_size': 1} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1939328838',display_name='tempest-VolumesGetTest-Volume-1143418727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3a166dc5a74bd6ac5a4687638afa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:23Z,use_quota=True,user_id='d1bed7f354b44398b69c54e6504b3431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Creating volume b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:23 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:23 devstack sudo[110437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 1073741824 Jun 27 20:09:23 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-f460b095-d55c-4074-a2ac-e71888d7f53c-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-f460b095-d55c-4074-a2ac-e71888d7f53c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "cinder-quobyte-f460b095-d55c-4074-a2ac-e71888d7f53c" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-f460b095-d55c-4074-a2ac-e71888d7f53c" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[537fba5d-9c7d-47b5-8b1e-fd3e26cf3adc]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:23 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c Jun 27 20:09:23 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:23 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.729s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Deleted volume successfully. Jun 27 20:09:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-ce6f9559-68fe-422c-aa2f-b329ecd7dc80 tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-708fa957-b7bb-4330-88b3-fb8cc00070e7-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:24 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 1073741824" returned: 0 in 0.870s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:24 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 Jun 27 20:09:24 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:24 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c" returned: 0 in 0.776s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:24 devstack sudo[110452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c Jun 27 20:09:24 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:25 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84" returned: 0 in 0.672s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5123c39e-c496-4ed8-9432-37bd7e37e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da8db77-a94a-48f2-8e5d-5163216ed102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:25 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Volume volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 (b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84): created successfully Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da8db77-a94a-48f2-8e5d-5163216ed102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Flow 'volume_create_manager' (4501b234-6523-4f54-87fb-e00ed557bd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:25 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f460b095-d55c-4074-a2ac-e71888d7f53c" returned: 0 in 0.650s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fb0faf71-eed1-4756-804b-f10f4ec466d8 tempest-VolumesGetTest-86149708 None] Created volume successfully. Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-quobyte-f460b095-d55c-4074-a2ac-e71888d7f53c" released by "delete_volume" :: held 1.474s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Created reservations ['aadf447a-b2bb-40d9-9052-f3802d0f21a2', 'c0fe0eda-0b9c-46e5-acc3-255c59e312f6', '8910dd04-a44d-4146-a205-da62223029aa', '9669a827-2cfa-4aa6-887c-7ee5aad66b9b'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:25 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:25 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Lock "cinder-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84" acquired by "delete_volume" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69faeebf-b7ff-4c0f-854f-53278562d2a1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:25 devstack sudo[110458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 Jun 27 20:09:25 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:25 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.707s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:25 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Deleted volume successfully. Jun 27 20:09:25 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2b66b244-426e-4785-9e64-bf0b35bdf4ce tempest-CreateVolumesFromImageTest-377691049 None] Lock "cinder-f460b095-d55c-4074-a2ac-e71888d7f53c-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:26 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12ff81d-c246-421e-ba88-d852e46755e8]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:26 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84" returned: 0 in 0.818s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:26 devstack sudo[110471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 Jun 27 20:09:26 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:26 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84 Jun 27 20:09:26 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:27 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84" released by "delete_volume" :: held 1.585s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:27 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784" returned: 0 in 0.934s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.960s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Created reservations ['92afa27d-6bdd-4195-b842-e30d835d14ca', '605ead78-ebbf-4587-9abc-6a1096fb9c02', '237f0c95-7e56-4ce5-81fe-4ab0c3101ae4', 'beae436c-68bd-43ba-8356-e6cae890db36'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-850490b6-8d35-49ec-a9fd-39e02eba7784', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e574e5f-e34c-40f3-bb9c-8752692b693e', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:27 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-c0ec985d-2752-4171-a686-c1a49e5b85cc req-90700831-35e0-4fb4-a7fa-3d521e03513a tempest-TestServerVolumeAttachmentScenario-803889416 None] attachment_update completed successfully. Jun 27 20:09:27 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:27 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-5a15a3fe-7241-48cb-9fc1-b900ae85d375-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Lock "cinder-5a15a3fe-7241-48cb-9fc1-b900ae85d375-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Acquiring lock "cinder-quobyte-5a15a3fe-7241-48cb-9fc1-b900ae85d375" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-5a15a3fe-7241-48cb-9fc1-b900ae85d375" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b15cd25-5c37-474d-ae47-515aa8d7e32b]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:28 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:09:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dfa937b7-9072-4f4e-8054-d928387662cc tempest-VolumesGetTest-86149708 None] Lock "cinder-b9bd3e2f-3eec-4c8d-b93e-1d925f80ed84-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:28 devstack sudo[110483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:28 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:29 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 0 in 0.891s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:29 devstack sudo[110492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:29 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:29 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 1 in 0.897s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:09:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:29 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375 Jun 27 20:09:29 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:30 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5a15a3fe-7241-48cb-9fc1-b900ae85d375" returned: 0 in 0.678s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Lock "cinder-quobyte-5a15a3fe-7241-48cb-9fc1-b900ae85d375" released by "delete_volume" :: held 2.551s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Created reservations ['26fa0b67-66c1-4a30-aa17-b07593f7e3bb', 'c1f8a918-c7cf-4ca4-a8c5-913308f395d7', '68a93470-893d-47b9-b312-70085af79c03', '640bd898-d8c8-478a-84ce-1ad38ec6e9c2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:30 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:30 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:31 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.773s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:31 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Deleted volume successfully. Jun 27 20:09:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-01fe0bf0-59f7-49d8-9cad-6749592b102b tempest-VolumesGetTest-86149708 None] Lock "cinder-5a15a3fe-7241-48cb-9fc1-b900ae85d375-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Flow 'volume_create_manager' (8996b4e7-ade6-41af-a9b2-00956c11d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f0402a-574e-4348-9ba2-079696645360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f0402a-574e-4348-9ba2-079696645360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1594648220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea412af-5a49-4e90-91c1-865864fbc8d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='692a3baeed5a43fb97aad20bf93aa08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:35Z,use_quota=True,user_id='b29ebdcbc8e948cf9e260a1067f3480d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dc01a7-2bcc-48e6-8cbf-fff7d2ceea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dc01a7-2bcc-48e6-8cbf-fff7d2ceea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55ad45c-4674-40ce-90f9-cb157a532cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55ad45c-4674-40ce-90f9-cb157a532cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea412af-5a49-4e90-91c1-865864fbc8d4', 'volume_name': 'volume-6ea412af-5a49-4e90-91c1-865864fbc8d4', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f146eba-c1a8-408e-8e6c-db9540bbd765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f146eba-c1a8-408e-8e6c-db9540bbd765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416fe181-cd46-4952-b5e0-415bf25145c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Volume 6ea412af-5a49-4e90-91c1-865864fbc8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea412af-5a49-4e90-91c1-865864fbc8d4', 'volume_size': 1} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1594648220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea412af-5a49-4e90-91c1-865864fbc8d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='692a3baeed5a43fb97aad20bf93aa08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:35Z,use_quota=True,user_id='b29ebdcbc8e948cf9e260a1067f3480d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Creating volume 6ea412af-5a49-4e90-91c1-865864fbc8d4 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:34 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:34 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-ef11b443-ad8f-412e-be1b-628eecf26d3d req-08c83ed1-1470-4403-b720-449488f1b00a tempest-TestServerVolumeAttachmentScenario-803889416 None] Terminate volume connection completed successfully. Jun 27 20:09:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-ef11b443-ad8f-412e-be1b-628eecf26d3d req-08c83ed1-1470-4403-b720-449488f1b00a tempest-TestServerVolumeAttachmentScenario-803889416 None] Deleting attachment 3e574e5f-e34c-40f3-bb9c-8752692b693e. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:09:34 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 1073741824 Jun 27 20:09:34 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:35 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 1073741824" returned: 0 in 0.954s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:35 devstack sudo[110551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 Jun 27 20:09:35 devstack sudo[110551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:36 devstack sudo[110551]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4" returned: 0 in 0.735s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416fe181-cd46-4952-b5e0-415bf25145c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea412af-5a49-4e90-91c1-865864fbc8d4', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d994ca1-fd66-4352-a59c-572832368591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:36 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Volume volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 (6ea412af-5a49-4e90-91c1-865864fbc8d4): created successfully Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d994ca1-fd66-4352-a59c-572832368591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Flow 'volume_create_manager' (8996b4e7-ade6-41af-a9b2-00956c11d063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-919dfa10-2484-4551-989f-e7586c88550c tempest-VolumesListTestJSON-469184513 None] Created volume successfully. Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Flow 'volume_create_manager' (1ba7f08d-6604-4ef0-9979-d9edd591501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056dd0df-ea40-4017-919f-367ee4f2f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056dd0df-ea40-4017-919f-367ee4f2f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2108512832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6727dbd1-bbdb-4b43-8e7d-35dad1ad057d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='692a3baeed5a43fb97aad20bf93aa08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:37Z,use_quota=True,user_id='b29ebdcbc8e948cf9e260a1067f3480d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f93635-c182-4d5a-994d-5c157cc2a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f93635-c182-4d5a-994d-5c157cc2a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4a3086-d0fb-49de-a047-30e98fbf3db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4a3086-d0fb-49de-a047-30e98fbf3db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6727dbd1-bbdb-4b43-8e7d-35dad1ad057d', 'volume_name': 'volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a508f688-d843-44f3-8a4e-632f58c43326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a508f688-d843-44f3-8a4e-632f58c43326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ef72cc-06ee-495d-8540-91d8be4905e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:37 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Volume 6727dbd1-bbdb-4b43-8e7d-35dad1ad057d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d', 'volume_size': 1} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2108512832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6727dbd1-bbdb-4b43-8e7d-35dad1ad057d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='692a3baeed5a43fb97aad20bf93aa08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:37Z,use_quota=True,user_id='b29ebdcbc8e948cf9e260a1067f3480d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Creating volume 6727dbd1-bbdb-4b43-8e7d-35dad1ad057d {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:37 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:37 devstack sudo[110578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d 1073741824 Jun 27 20:09:37 devstack sudo[110578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-b6e332d3-9923-4c96-88f3-9d635e2cf5b7 req-ccd6eeb9-95b3-4a8a-8b27-0613199eefcd tempest-TestServerVolumeAttachmentScenario-803889416 None] Terminate volume connection completed successfully. Jun 27 20:09:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b6e332d3-9923-4c96-88f3-9d635e2cf5b7 req-ccd6eeb9-95b3-4a8a-8b27-0613199eefcd tempest-TestServerVolumeAttachmentScenario-803889416 None] Deleting attachment ae949a7f-ec44-4cdb-bb4c-8527ea622cb1. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:09:38 devstack sudo[110578]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d 1073741824" returned: 0 in 0.969s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:38 devstack sudo[110590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d Jun 27 20:09:38 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:39 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d" returned: 0 in 0.871s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ef72cc-06ee-495d-8540-91d8be4905e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bee4382-bbd2-4b8a-862e-af7c17d59989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:39 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Volume volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d (6727dbd1-bbdb-4b43-8e7d-35dad1ad057d): created successfully Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bee4382-bbd2-4b8a-862e-af7c17d59989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Flow 'volume_create_manager' (1ba7f08d-6604-4ef0-9979-d9edd591501d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c6eebf53-c7ac-4e2e-85ae-8a2b01118947 tempest-VolumesListTestJSON-469184513 None] Created volume successfully. Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=109,cinder:INSERT=32,cinder:UPDATE=120,cinder:DELETE=9 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=84,cinder:INSERT=36,cinder:UPDATE=132,cinder:DELETE=13 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Flow 'volume_create_manager' (371a5df4-44ab-42d0-a33a-812d82a8a3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e493340-e18b-4294-8f6a-b89221f3b580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e493340-e18b-4294-8f6a-b89221f3b580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1659381562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdecb1b6-2139-4f5c-a334-db3c56655603,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='692a3baeed5a43fb97aad20bf93aa08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:41Z,use_quota=True,user_id='b29ebdcbc8e948cf9e260a1067f3480d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0dd6fc-4e37-4fbf-a5a7-38a78c00ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0dd6fc-4e37-4fbf-a5a7-38a78c00ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603c1fa1-ef67-4fcb-8fef-0f8197871183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603c1fa1-ef67-4fcb-8fef-0f8197871183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdecb1b6-2139-4f5c-a334-db3c56655603', 'volume_name': 'volume-cdecb1b6-2139-4f5c-a334-db3c56655603', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf2edaa-a619-4044-b4c7-29bdc13c9eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf2edaa-a619-4044-b4c7-29bdc13c9eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbf8dda-176b-4a9a-a3c1-d6cf609c38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:41 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Volume cdecb1b6-2139-4f5c-a334-db3c56655603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdecb1b6-2139-4f5c-a334-db3c56655603', 'volume_size': 1} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1659381562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdecb1b6-2139-4f5c-a334-db3c56655603,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='692a3baeed5a43fb97aad20bf93aa08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:41Z,use_quota=True,user_id='b29ebdcbc8e948cf9e260a1067f3480d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Creating volume cdecb1b6-2139-4f5c-a334-db3c56655603 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:41 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:41 devstack sudo[110593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 1073741824 Jun 27 20:09:41 devstack sudo[110593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:42 devstack sudo[110593]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 1073741824" returned: 0 in 1.241s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:42 devstack sudo[110638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 Jun 27 20:09:42 devstack sudo[110638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:43 devstack sudo[110638]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603" returned: 0 in 0.743s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbf8dda-176b-4a9a-a3c1-d6cf609c38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdecb1b6-2139-4f5c-a334-db3c56655603', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca50caf-aa5a-4e29-b115-78b49e36f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:43 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Volume volume-cdecb1b6-2139-4f5c-a334-db3c56655603 (cdecb1b6-2139-4f5c-a334-db3c56655603): created successfully Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca50caf-aa5a-4e29-b115-78b49e36f98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Flow 'volume_create_manager' (371a5df4-44ab-42d0-a33a-812d82a8a3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:43 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f3d0ff2e-855a-48cc-8af4-8f8daeddb3b6 tempest-VolumesListTestJSON-469184513 None] Created volume successfully. Jun 27 20:09:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "cinder-cdecb1b6-2139-4f5c-a334-db3c56655603-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-cdecb1b6-2139-4f5c-a334-db3c56655603-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "cinder-quobyte-cdecb1b6-2139-4f5c-a334-db3c56655603" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:46 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-quobyte-cdecb1b6-2139-4f5c-a334-db3c56655603" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:46 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29a778-5c37-4a93-83e6-e7be87d951d9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:47 devstack sudo[110645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 Jun 27 20:09:47 devstack sudo[110645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:47 devstack sudo[110645]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603" returned: 0 in 1.022s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:47 devstack sudo[110651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603 Jun 27 20:09:48 devstack sudo[110651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:48 devstack sudo[110651]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cdecb1b6-2139-4f5c-a334-db3c56655603" returned: 0 in 0.690s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-quobyte-cdecb1b6-2139-4f5c-a334-db3c56655603" released by "delete_volume" :: held 1.786s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Created reservations ['5dc39822-d2e7-4a09-a37b-33386f944ca9', '42469656-74d7-4b2a-bb45-53fb9eec2008', '1e68c950-fbc9-4281-b3c3-78678f5aea50', '08e2ec63-8170-4179-b7f2-c8dae18960ab'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:48 devstack sudo[110654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:48 devstack sudo[110654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Acquiring lock "cinder-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Lock "cinder-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Acquiring lock "cinder-quobyte-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Lock "cinder-quobyte-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ca8f10-2eb3-4b62-9a9b-f4733dd44377]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:49 devstack sudo[110656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d Jun 27 20:09:49 devstack sudo[110656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "cinder-850490b6-8d35-49ec-a9fd-39e02eba7784-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-850490b6-8d35-49ec-a9fd-39e02eba7784-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "cinder-quobyte-850490b6-8d35-49ec-a9fd-39e02eba7784" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:49 devstack sudo[110654]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-quobyte-850490b6-8d35-49ec-a9fd-39e02eba7784" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.822s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Deleted volume successfully. Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce8bbe-2417-4e8c-bcf4-92168e14636b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7e9512ac-c01f-409b-b133-aebf0024d868 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-cdecb1b6-2139-4f5c-a334-db3c56655603-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:49 devstack sudo[110659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 Jun 27 20:09:49 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:50 devstack sudo[110656]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d" returned: 0 in 1.017s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:50 devstack sudo[110664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d Jun 27 20:09:50 devstack sudo[110664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:50 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784" returned: 0 in 1.081s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:50 devstack sudo[110669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784 Jun 27 20:09:50 devstack sudo[110669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:51 devstack sudo[110664]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d" returned: 0 in 0.753s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Lock "cinder-quobyte-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d" released by "delete_volume" :: held 1.827s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Created reservations ['974ead0f-52ab-44c8-9a40-b1c263f36b15', '8c7d21bd-3800-4835-a3ff-91aede9cbab7', '5e3e667f-da94-4f44-ab23-6b3e28c3dbaf', '0a21478a-c424-4f70-9fb0-d8ca79e0b6dc'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:51 devstack sudo[110672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:51 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:51 devstack sudo[110669]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "cinder-6ea412af-5a49-4e90-91c1-865864fbc8d4-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-850490b6-8d35-49ec-a9fd-39e02eba7784" returned: 0 in 0.738s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-quobyte-850490b6-8d35-49ec-a9fd-39e02eba7784" released by "delete_volume" :: held 1.881s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-6ea412af-5a49-4e90-91c1-865864fbc8d4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "cinder-quobyte-6ea412af-5a49-4e90-91c1-865864fbc8d4" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Flow 'volume_create_manager' (fa1e56be-219e-4490-aa0d-e1589736383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2102eb7d-a88b-4325-962c-e29a3c724f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-quobyte-6ea412af-5a49-4e90-91c1-865864fbc8d4" acquired by "delete_volume" :: waited 0.066s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2102eb7d-a88b-4325-962c-e29a3c724f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-742876686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc931a7-79ba-4e0e-8d40-61c00bb31602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1133e11ee647cb887018845157f8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:52Z,use_quota=True,user_id='957b549c34a24a2eb8b944d91b7afdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa93d11-7dc7-45c9-86b5-70e54ba901fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa93d11-7dc7-45c9-86b5-70e54ba901fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e165cb5-db78-4474-85bd-b22f1a36f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e165cb5-db78-4474-85bd-b22f1a36f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc931a7-79ba-4e0e-8d40-61c00bb31602', 'volume_name': 'volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666c322f-a399-47cd-9787-60f2430460d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666c322f-a399-47cd-9787-60f2430460d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578262a1-19b4-49f1-a940-59527a122000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Volume 8fc931a7-79ba-4e0e-8d40-61c00bb31602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602', 'volume_size': 1} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-742876686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc931a7-79ba-4e0e-8d40-61c00bb31602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1133e11ee647cb887018845157f8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:52Z,use_quota=True,user_id='957b549c34a24a2eb8b944d91b7afdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Creating volume 8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:09:51 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdc7828-3059-470d-9cd2-2ae4bf05420e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:51 devstack sudo[110675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 1073741824 Jun 27 20:09:51 devstack sudo[110675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Created reservations ['edcfaf4d-8331-4c21-9526-b877bff1961a', '4e871736-756e-4988-825c-92d625472a6f', '2494d80c-f945-4ad0-959e-ea7ed1dd5850', '7ba61817-23ec-44ed-a1d4-7c9f85858695'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:51 devstack sudo[110678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:51 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:52 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 Jun 27 20:09:52 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "cinder-f835299d-51e4-492a-a52c-5b9598753062-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-f835299d-51e4-492a-a52c-5b9598753062-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "cinder-quobyte-f835299d-51e4-492a-a52c-5b9598753062" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-quobyte-f835299d-51e4-492a-a52c-5b9598753062" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6790ede-7eb7-4983-9ce3-5aa5afbd7775]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:52 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.984s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Deleted volume successfully. Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4460d116-d2f8-48f6-9793-e6065f113f3a tempest-VolumesListTestJSON-469184513 None] Lock "cinder-6727dbd1-bbdb-4b43-8e7d-35dad1ad057d-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:52 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 Jun 27 20:09:52 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:52 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.827s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Deleted volume successfully. Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-e2a02ec0-0f7c-4ddc-bf50-0cbdd8e236a1 tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-850490b6-8d35-49ec-a9fd-39e02eba7784-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:52 devstack sudo[110675]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 1073741824" returned: 0 in 1.047s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:52 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4" returned: 0 in 1.066s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:52 devstack sudo[110695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4 Jun 27 20:09:52 devstack sudo[110695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:52 devstack sudo[110697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:09:52 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:53 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062" returned: 0 in 0.849s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:53 devstack sudo[110700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062 Jun 27 20:09:53 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:53 devstack sudo[110695]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6ea412af-5a49-4e90-91c1-865864fbc8d4" returned: 0 in 0.674s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:53 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 0.674s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-quobyte-6ea412af-5a49-4e90-91c1-865864fbc8d4" released by "delete_volume" :: held 1.864s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578262a1-19b4-49f1-a940-59527a122000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d940d-d696-4acb-a867-39de907dbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Volume volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 (8fc931a7-79ba-4e0e-8d40-61c00bb31602): created successfully Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d940d-d696-4acb-a867-39de907dbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Flow 'volume_create_manager' (fa1e56be-219e-4490-aa0d-e1589736383d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:53 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a7743bf3-ac6f-4a41-9ea3-1b62d5b22196 tempest-SnapshotDependencyTests-22464566 None] Created volume successfully. Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-f835299d-51e4-492a-a52c-5b9598753062" returned: 0 in 0.642s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Created reservations ['aa47442a-d66c-4c35-b84f-ea559acc240b', 'a536c927-076c-494f-8566-84be4303a2d2', '2b95cb70-36dd-4ea2-b530-5e2143f49f94', 'b4d95990-1d95-4c57-bf3a-d2c2b38deb0a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-quobyte-f835299d-51e4-492a-a52c-5b9598753062" released by "delete_volume" :: held 1.554s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:53 devstack sudo[110705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:53 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Created reservations ['47c3be9c-3ca3-448d-953d-6e2fb32591af', '8a5b8f3f-4017-4024-a576-688e233dde1f', 'ecb7fe0d-406c-4b4d-89e6-a26a69635fd5', 'b9108b15-df52-40ae-b834-6f72b3948aeb'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:09:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:53 devstack sudo[110707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:09:53 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:54 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.749s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:54 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Deleted volume successfully. Jun 27 20:09:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5ae016ee-13ed-44cb-a82d-a2bc30388d57 tempest-VolumesListTestJSON-469184513 None] Lock "cinder-6ea412af-5a49-4e90-91c1-865864fbc8d4-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:54 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.722s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:54 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:09:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Deleted volume successfully. Jun 27 20:09:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-611e2fb6-fc5d-4753-ba43-714162f93f4a tempest-TestServerVolumeAttachmentScenario-803889416 None] Lock "cinder-f835299d-51e4-492a-a52c-5b9598753062-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:09:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:09:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Creating offline snapshot c3ce2818-131f-4825-aa7d-f27c4726c26e of volume 8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:09:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[450d7630-b1cb-4a11-ae94-8bf47d008982]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:09:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:55 devstack sudo[110712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:09:55 devstack sudo[110712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:56 devstack sudo[110712]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 0.871s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:56 devstack sudo[110719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e 1G Jun 27 20:09:56 devstack sudo[110719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:57 devstack sudo[110719]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e 1G" returned: 0 in 1.051s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:57 devstack sudo[110725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e Jun 27 20:09:57 devstack sudo[110725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Flow 'volume_create_manager' (aa4fd1b1-da26-4322-96f7-f4e7e59d7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df66aefd-ca92-42f8-a515-af00302aa762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df66aefd-ca92-42f8-a515-af00302aa762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-909410982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689a7f44-72dd-4e62-a1fc-df2053217d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5854cbecab13412888ebb0ef8e7d5bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:57Z,use_quota=True,user_id='1b504fb652d44958aff6f3fc84559fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcef078c-45da-4128-849f-fcda2ef12685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcef078c-45da-4128-849f-fcda2ef12685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e51b250-d030-4e9e-97c3-55c88fd65e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e51b250-d030-4e9e-97c3-55c88fd65e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689a7f44-72dd-4e62-a1fc-df2053217d4c', 'volume_name': 'volume-689a7f44-72dd-4e62-a1fc-df2053217d4c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06047754-d31a-451e-b6cd-ba32688071ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06047754-d31a-451e-b6cd-ba32688071ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f66269-ed29-40e3-8da1-e3303291c58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:09:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Volume 689a7f44-72dd-4e62-a1fc-df2053217d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689a7f44-72dd-4e62-a1fc-df2053217d4c', 'volume_size': 1} Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:09:57 devstack sudo[110725]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e" returned: 0 in 0.802s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:57 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e is being set with open permissions: ugo+rw Jun 27 20:09:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:57 devstack sudo[110730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e Jun 27 20:09:57 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:58 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e" returned: 0 in 0.716s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:58 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info Jun 27 20:09:58 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:09:59 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Jun 27 20:09:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:09:59 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info is being set with open permissions: ugo+rw Jun 27 20:09:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:09:59 devstack sudo[110738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info Jun 27 20:09:59 devstack sudo[110738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:00 devstack sudo[110738]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.info" returned: 0 in 0.635s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.722s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-909410982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689a7f44-72dd-4e62-a1fc-df2053217d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5854cbecab13412888ebb0ef8e7d5bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:09:57Z,use_quota=True,user_id='1b504fb652d44958aff6f3fc84559fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Creating volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:00 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:00 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c 1073741824 Jun 27 20:10:00 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-01035391-f649-4f95-86af-a9b1f157b1d1 tempest-SnapshotDependencyTests-22464566 None] Create snapshot completed successfully Jun 27 20:10:00 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c 1073741824" returned: 0 in 0.903s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:01 devstack sudo[110747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c Jun 27 20:10:01 devstack sudo[110747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Flow 'volume_create_manager' (507fe233-0b1b-400d-bd45-14a96edf123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170ad380-e517-4c28-a81c-c22770f4be6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170ad380-e517-4c28-a81c-c22770f4be6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b8dfe6-5194-4d72-b27b-c8e31e03481c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1133e11ee647cb887018845157f8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3ce2818-131f-4825-aa7d-f27c4726c26e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:01Z,use_quota=True,user_id='957b549c34a24a2eb8b944d91b7afdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f72e7b-7473-44f4-ba75-c86ada335d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f72e7b-7473-44f4-ba75-c86ada335d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646344c6-b1d9-4c0f-9834-d1a4dbd5e4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646344c6-b1d9-4c0f-9834-d1a4dbd5e4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32b8dfe6-5194-4d72-b27b-c8e31e03481c', 'volume_name': 'volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c', 'volume_size': 1, 'snapshot_id': 'c3ce2818-131f-4825-aa7d-f27c4726c26e'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73499df2-1828-4335-bfe2-4f77f8d27309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73499df2-1828-4335-bfe2-4f77f8d27309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdf76fb-5fb5-4293-a860-7aced6de73a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Volume 32b8dfe6-5194-4d72-b27b-c8e31e03481c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c', 'volume_size': 1, 'snapshot_id': 'c3ce2818-131f-4825-aa7d-f27c4726c26e'} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:01 devstack sudo[110747]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c" returned: 0 in 0.763s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.544s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-quobyte-c3ce2818-131f-4825-aa7d-f27c4726c26e-32b8dfe6-5194-4d72-b27b-c8e31e03481c" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f66269-ed29-40e3-8da1-e3303291c58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689a7f44-72dd-4e62-a1fc-df2053217d4c', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2188cdee-12a9-455b-b9c5-35d65ad5bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-c3ce2818-131f-4825-aa7d-f27c4726c26e-32b8dfe6-5194-4d72-b27b-c8e31e03481c" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Creating volume 32b8dfe6-5194-4d72-b27b-c8e31e03481c from snapshot c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-quobyte-32b8dfe6-5194-4d72-b27b-c8e31e03481c" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-32b8dfe6-5194-4d72-b27b-c8e31e03481c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] snapshot: c3ce2818-131f-4825-aa7d-f27c4726c26e, volume: 32b8dfe6-5194-4d72-b27b-c8e31e03481c, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:10:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Volume volume-689a7f44-72dd-4e62-a1fc-df2053217d4c (689a7f44-72dd-4e62-a1fc-df2053217d4c): created successfully Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2188cdee-12a9-455b-b9c5-35d65ad5bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Flow 'volume_create_manager' (aa4fd1b1-da26-4322-96f7-f4e7e59d7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6ced1342-4bab-468e-8c1c-f05149a8e92e tempest-VolumesSnapshotListTestJSON-1351992499 None] Created volume successfully. Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa80a415-6aaf-4d7e-a6ec-5292e00ed692]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:02 devstack sudo[110751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e Jun 27 20:10:02 devstack sudo[110751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:02 devstack sudo[110751]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e" returned: 0 in 0.865s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6ab684-6944-4631-b27f-06d657023874]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:03 devstack sudo[110757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:10:03 devstack sudo[110757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:03 devstack sudo[110757]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 0.791s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:03 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:10:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:03 devstack sudo[110765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c Jun 27 20:10:03 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:09 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c" returned: 0 in 5.575s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:09 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de4cf17-ed53-4f55-8a49-eb59b6cd9e08]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:09 devstack sudo[110789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:10:09 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:10 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 1.000s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:10:10 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Converted 1024.00 MB image at 183.64 MB/s Jun 27 20:10:10 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c is being set with open permissions: ugo+rw Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:10 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c Jun 27 20:10:10 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:10 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c" returned: 0 in 0.676s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-32b8dfe6-5194-4d72-b27b-c8e31e03481c" released by "_copy_volume_from_snapshot" :: held 9.060s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-c3ce2818-131f-4825-aa7d-f27c4726c26e-32b8dfe6-5194-4d72-b27b-c8e31e03481c" released by "_create_volume_from_snapshot" :: held 9.104s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.153s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.195s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Creating offline snapshot af3dbc9a-52e4-4710-8ae4-777e9b6b5623 of volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfbc269-6e83-450a-9a0a-6e2e69e4bec4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdf76fb-5fb5-4293-a860-7aced6de73a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c', 'volume_size': 1, 'snapshot_id': 'c3ce2818-131f-4825-aa7d-f27c4726c26e'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7602df-6588-4c74-86d0-3a7d2bf54d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Volume volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c (32b8dfe6-5194-4d72-b27b-c8e31e03481c): created successfully Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7602df-6588-4c74-86d0-3a7d2bf54d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Flow 'volume_create_manager' (507fe233-0b1b-400d-bd45-14a96edf123f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d0d3900a-f3ed-4e9c-b22c-1c86736b6799 tempest-SnapshotDependencyTests-22464566 None] Created volume successfully. Jun 27 20:10:11 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c Jun 27 20:10:11 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:11 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c" returned: 0 in 0.921s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:11 devstack sudo[110804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 1G Jun 27 20:10:11 devstack sudo[110804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-c3ce2818-131f-4825-aa7d-f27c4726c26e-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-c3ce2818-131f-4825-aa7d-f27c4726c26e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-quobyte-8fc931a7-79ba-4e0e-8d40-61c00bb31602" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-8fc931a7-79ba-4e0e-8d40-61c00bb31602" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-quobyte-c3ce2818-131f-4825-aa7d-f27c4726c26e" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-c3ce2818-131f-4825-aa7d-f27c4726c26e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Deleting offline snapshot c3ce2818-131f-4825-aa7d-f27c4726c26e of volume 8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] snapshot_file for this snap is: volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e35d19-e20e-4082-9bf7-86b0a3e7571e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:12 devstack sudo[110806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e Jun 27 20:10:12 devstack sudo[110806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:12 devstack sudo[110804]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 1G" returned: 0 in 0.875s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:12 devstack sudo[110812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:12 devstack sudo[110812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:13 devstack sudo[110806]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce560211-4ee9-4abd-b36b-f059d4f6f7c6]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:13 devstack sudo[110818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:10:13 devstack sudo[110818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:13 devstack sudo[110812]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.758s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:13 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 is being set with open permissions: ugo+rw Jun 27 20:10:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:13 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:13 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:14 devstack sudo[110818]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 0.869s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:14 devstack sudo[110829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e Jun 27 20:10:14 devstack sudo[110829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:14 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.753s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:14 devstack sudo[110833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info Jun 27 20:10:14 devstack sudo[110833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:14 devstack sudo[110829]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e" returned: 0 in 0.802s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:14 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e Jun 27 20:10:14 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:15 devstack sudo[110833]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:15 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info is being set with open permissions: ugo+rw Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:15 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info Jun 27 20:10:15 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:15 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602.c3ce2818-131f-4825-aa7d-f27c4726c26e" returned: 0 in 0.728s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-c3ce2818-131f-4825-aa7d-f27c4726c26e" released by "_delete_snapshot" :: held 3.381s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-8fc931a7-79ba-4e0e-8d40-61c00bb31602" released by "delete_snapshot" :: held 3.416s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Created reservations ['cfa8b214-ab34-43a7-af8b-c4e1c8d21c0d', '2091f33a-882e-4a10-b5f2-fdc3d1634df7', 'c5da9960-e758-458a-81f8-28e37491a588', '73ce25ff-b37c-408a-a84b-8a05c0b186f2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:15 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.info" returned: 0 in 0.704s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c5c592a8-545f-4499-905a-596f42bce71f tempest-VolumesSnapshotListTestJSON-1351992499 None] Create snapshot completed successfully Jun 27 20:10:15 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Delete snapshot completed successfully. Jun 27 20:10:15 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fa0b756c-fd3d-4297-b9a3-a797fa8f8b5a tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-c3ce2818-131f-4825-aa7d-f27c4726c26e-delete_snapshot" released by "delete_snapshot" :: held 3.655s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:16 devstack sudo[110846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:10:16 devstack sudo[110846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-8fc931a7-79ba-4e0e-8d40-61c00bb31602-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-8fc931a7-79ba-4e0e-8d40-61c00bb31602-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-quobyte-8fc931a7-79ba-4e0e-8d40-61c00bb31602" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-8fc931a7-79ba-4e0e-8d40-61c00bb31602" acquired by "delete_volume" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d0cc4e-4c94-4d1c-bf6f-72b77291268f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Creating offline snapshot fab270ca-3221-4597-a5e9-495afe4ea73d of volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:10:16 devstack sudo[110848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:10:16 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8c91f-b093-436a-a080-85f9ef2dc67a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:16 devstack sudo[110846]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.721s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:10:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:10:17 devstack sudo[110851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:17 devstack sudo[110851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:17 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 0.981s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:17 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602 Jun 27 20:10:17 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:17 devstack sudo[110851]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.878s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:17 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:17 devstack sudo[110861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d 1G Jun 27 20:10:17 devstack sudo[110861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:18 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8fc931a7-79ba-4e0e-8d40-61c00bb31602" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-8fc931a7-79ba-4e0e-8d40-61c00bb31602" released by "delete_volume" :: held 1.768s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Created reservations ['a45910e0-402b-4a35-b124-2c94872fba83', 'd7160f8a-2875-4421-89a0-ed5daf750e20', '55e23c3b-3873-48a5-841c-4a9af42a334e', '729a1358-5999-4659-94b7-e33e981872a4'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:18 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:10:18 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-32b8dfe6-5194-4d72-b27b-c8e31e03481c-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:18 devstack sudo[110861]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-32b8dfe6-5194-4d72-b27b-c8e31e03481c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d 1G" returned: 0 in 1.024s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:18 devstack sudo[110870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:18 devstack sudo[110870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "cinder-quobyte-32b8dfe6-5194-4d72-b27b-c8e31e03481c" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-32b8dfe6-5194-4d72-b27b-c8e31e03481c" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6671f8-9e3e-42e4-b574-bdc9cbba0669]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:19 devstack sudo[110872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c Jun 27 20:10:19 devstack sudo[110872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:19 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.858s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:10:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Deleted volume successfully. Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76decc42-11a0-4b8d-a2b3-bc9738bf3f32 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-8fc931a7-79ba-4e0e-8d40-61c00bb31602-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:19 devstack sudo[110870]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.868s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:19 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d is being set with open permissions: ugo+rw Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:19 devstack sudo[110878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:19 devstack sudo[110878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:19 devstack sudo[110872]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c" returned: 0 in 0.999s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:19 devstack sudo[110883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c Jun 27 20:10:19 devstack sudo[110883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:20 devstack sudo[110878]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.621s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-cde2ae8f-862e-4794-8405-3a2f05afa821 tempest-VolumesSnapshotListTestJSON-1351992499 None] Create snapshot completed successfully Jun 27 20:10:20 devstack sudo[110883]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-32b8dfe6-5194-4d72-b27b-c8e31e03481c" returned: 0 in 0.710s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-quobyte-32b8dfe6-5194-4d72-b27b-c8e31e03481c" released by "delete_volume" :: held 1.762s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Created reservations ['728abec9-368e-41f3-ad73-a672442ffa74', 'ced9cf90-1d1b-459b-a4c2-7e6ee45625f9', '2b9293e3-da38-4e68-a216-d5323ce5955d', 'a0e7fb2f-a24e-4286-a211-2564c7f027e4'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:20 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:10:20 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Creating offline snapshot 15b6d374-bc02-4c97-acb2-9799b66a77ae of volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba6bc7-4bfc-44d8-9373-8f6510c41656]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:21 devstack sudo[110890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:21 devstack sudo[110890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:21 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.741s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:10:21 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Deleted volume successfully. Jun 27 20:10:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-78fda215-98f8-4153-ade9-68a3fba60662 tempest-SnapshotDependencyTests-22464566 None] Lock "cinder-32b8dfe6-5194-4d72-b27b-c8e31e03481c-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:22 devstack sudo[110890]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.869s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:22 devstack sudo[110896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae 1G Jun 27 20:10:22 devstack sudo[110896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:23 devstack sudo[110896]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae 1G" returned: 0 in 0.927s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:23 devstack sudo[110902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae Jun 27 20:10:23 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:24 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae" returned: 0 in 0.938s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:24 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae is being set with open permissions: ugo+rw Jun 27 20:10:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:24 devstack sudo[110908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae Jun 27 20:10:24 devstack sudo[110908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:24 devstack sudo[110908]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae" returned: 0 in 0.697s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.578s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dd9ee209-4731-4a16-b5bb-a3083224b703 tempest-VolumesSnapshotListTestJSON-1351992499 None] Create snapshot completed successfully Jun 27 20:10:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-15b6d374-bc02-4c97-acb2-9799b66a77ae-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-15b6d374-bc02-4c97-acb2-9799b66a77ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:26 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-15b6d374-bc02-4c97-acb2-9799b66a77ae" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-15b6d374-bc02-4c97-acb2-9799b66a77ae" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Deleting offline snapshot 15b6d374-bc02-4c97-acb2-9799b66a77ae of volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:10:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] snapshot_file for this snap is: volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:10:27 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de55b65-aef5-4c79-908b-f6552cd831fa]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:27 devstack sudo[110912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae Jun 27 20:10:27 devstack sudo[110912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:28 devstack sudo[110912]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae" returned: 0 in 1.058s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7478ed7-7bb2-4f36-b921-6583b71e01fb]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:28 devstack sudo[110919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:28 devstack sudo[110919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:29 devstack sudo[110919]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.907s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:29 devstack sudo[110925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae Jun 27 20:10:29 devstack sudo[110925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:30 devstack sudo[110925]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae" returned: 0 in 0.999s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:30 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae Jun 27 20:10:30 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:30 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.15b6d374-bc02-4c97-acb2-9799b66a77ae" returned: 0 in 0.754s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-15b6d374-bc02-4c97-acb2-9799b66a77ae" released by "_delete_snapshot" :: held 3.861s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:30 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" released by "delete_snapshot" :: held 3.894s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:30 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Created reservations ['ca490843-9c23-4844-9cc9-26ba2d6b5ac4', 'd9fd4b27-f6e5-470b-8a7b-6727bfec09d9', 'df407fd0-a91f-4d5a-932d-3e1e91905afb', 'e9f0ee21-a8fb-460e-b569-42be1b76a00a'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Delete snapshot completed successfully. Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-58bc19d8-72f1-402b-9278-46ebfab0c4f8 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-15b6d374-bc02-4c97-acb2-9799b66a77ae-delete_snapshot" released by "delete_snapshot" :: held 4.099s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-fab270ca-3221-4597-a5e9-495afe4ea73d-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-fab270ca-3221-4597-a5e9-495afe4ea73d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-fab270ca-3221-4597-a5e9-495afe4ea73d" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-fab270ca-3221-4597-a5e9-495afe4ea73d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Deleting offline snapshot fab270ca-3221-4597-a5e9-495afe4ea73d of volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] snapshot_file for this snap is: volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2d00af-808d-4809-9acb-e8568ca7a884]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:31 devstack sudo[110971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:31 devstack sudo[110971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.875s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:32 devstack sudo[110971]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3c98ba-30e8-4ca4-8c7e-c197615d8cf7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:32 devstack sudo[110977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:32 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Flow 'volume_create_manager' (6cbb3ecf-06b9-4818-9a43-6ee2401032d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a88320-9f2f-4843-8d47-b030a591d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a88320-9f2f-4843-8d47-b030a591d32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-723152954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71aa9322-6554-414b-941c-fd9234abef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006d9462e5f94695bafccf7823f07018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:33Z,use_quota=True,user_id='ae4131f2938d4689896019dcc98a80c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426953e2-a5f3-4075-8e3b-0eee922f862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426953e2-a5f3-4075-8e3b-0eee922f862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc083e10-68c6-44db-9634-144f5933d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:32 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc083e10-68c6-44db-9634-144f5933d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71aa9322-6554-414b-941c-fd9234abef2c', 'volume_name': 'volume-71aa9322-6554-414b-941c-fd9234abef2c', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c26265d-b2ed-4957-b16c-eba3bfb54d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c26265d-b2ed-4957-b16c-eba3bfb54d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9e631c-07d9-4242-86f0-49c9e22c6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:33 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Volume 71aa9322-6554-414b-941c-fd9234abef2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71aa9322-6554-414b-941c-fd9234abef2c', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Trying to clone 71aa9322-6554-414b-941c-fd9234abef2c from image 45e3a23f-5037-4170-820b-7e6bcfe7854f at location (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:10:33 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.908s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:33 devstack sudo[110983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:33 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:10:33 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Image download 20.69 MB at 20.69 MB/s Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f3a98-e32f-4bc7-933c-4d09f8167a97]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:33 devstack sudo[110986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD Jun 27 20:10:33 devstack sudo[110986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:34 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.874s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:34 devstack sudo[110992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d Jun 27 20:10:34 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:34 devstack sudo[110986]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD" returned: 0 in 0.936s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f is fetched for user ae4131f2938d4689896019dcc98a80c3. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[973060a4-f517-4db0-a6c0-cb3ff78d55ac]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:34 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD Jun 27 20:10:34 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:34 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.fab270ca-3221-4597-a5e9-495afe4ea73d" returned: 0 in 0.735s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-fab270ca-3221-4597-a5e9-495afe4ea73d" released by "_delete_snapshot" :: held 3.592s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" released by "delete_snapshot" :: held 3.623s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Created reservations ['3b23e5e3-afd3-487e-ae30-c2ff6518bb56', '4f08875e-8055-4dd6-b2e9-6d4899230b0e', '7a3a3747-3831-46c6-a7f0-5f11b756b22f', '38fdaac5-6349-484e-9bb9-efc28d9818ad'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:35 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Delete snapshot completed successfully. Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-be3b8394-2d44-4064-8497-3181704f3e8b tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-fab270ca-3221-4597-a5e9-495afe4ea73d-delete_snapshot" released by "delete_snapshot" :: held 3.811s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:35 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-723152954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71aa9322-6554-414b-941c-fd9234abef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006d9462e5f94695bafccf7823f07018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:33Z,use_quota=True,user_id='ae4131f2938d4689896019dcc98a80c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Creating volume 71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:35 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:35 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c 1073741824 Jun 27 20:10:35 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-af3dbc9a-52e4-4710-8ae4-777e9b6b5623-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-af3dbc9a-52e4-4710-8ae4-777e9b6b5623-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-af3dbc9a-52e4-4710-8ae4-777e9b6b5623" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-af3dbc9a-52e4-4710-8ae4-777e9b6b5623" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Deleting offline snapshot af3dbc9a-52e4-4710-8ae4-777e9b6b5623 of volume 689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] snapshot_file for this snap is: volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a1d4f-8feb-4fa1-9b25-bd1cc1072b18]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:35 devstack sudo[111005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:35 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:36 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c 1073741824" returned: 0 in 0.836s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:36 devstack sudo[111010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:10:36 devstack sudo[111010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:36 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689a7f44-72dd-4e62-a1fc-df2053217d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab96341-05cf-4030-ad33-45e0d48da799]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:36 devstack sudo[111015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c Jun 27 20:10:36 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:36 devstack sudo[111010]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 0.677s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:36 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Attempting download of 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 71aa9322-6554-414b-941c-fd9234abef2c. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[576cf620-371a-4745-ac07-4e7a8bd0fa19]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:37 devstack sudo[111018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd Jun 27 20:10:37 devstack sudo[111018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:37 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c" returned: 0 in 0.767s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:37 devstack sudo[111023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:37 devstack sudo[111023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:37 devstack sudo[111018]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:37 devstack sudo[111027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd Jun 27 20:10:37 devstack sudo[111027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:37 devstack sudo[111023]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:38 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623 Jun 27 20:10:38 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:38 devstack sudo[111027]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd" returned: 1 in 0.740s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45e3a23f-5037-4170-820b-7e6bcfe7854f_3gb7aodd' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb39ab60-d1ed-4373-a929-0e5a8a64e0aa]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:38 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c.af3dbc9a-52e4-4710-8ae4-777e9b6b5623" returned: 0 in 0.623s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:38 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD Jun 27 20:10:38 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-af3dbc9a-52e4-4710-8ae4-777e9b6b5623" released by "_delete_snapshot" :: held 3.005s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" released by "delete_snapshot" :: held 3.030s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Created reservations ['3db65ca5-d65b-4986-a6b7-82b7b8f662cc', '5719f03c-3709-4b5e-b15e-73c2c20c9232', 'a3cec292-ebe7-44cd-b4fe-79d05ed1febd', '702c5d81-d794-440c-8716-2ed42920b234'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Delete snapshot completed successfully. Jun 27 20:10:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f142edde-2f9c-4993-8bd0-cd34e3adf5c9 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-af3dbc9a-52e4-4710-8ae4-777e9b6b5623-delete_snapshot" released by "delete_snapshot" :: held 3.176s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:39 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] 45e3a23f-5037-4170-820b-7e6bcfe7854f was qcow2, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:39 devstack sudo[111042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:10:39 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-689a7f44-72dd-4e62-a1fc-df2053217d4c-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-689a7f44-72dd-4e62-a1fc-df2053217d4c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:10:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:10:40 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee38f3c-5694-43c4-a422-03333ffca530]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:40 devstack sudo[111050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c Jun 27 20:10:40 devstack sudo[111050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:40 devstack sudo[111050]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:40 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c Jun 27 20:10:40 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:41 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 1.821s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45e3a23f-5037-4170-820b-7e6bcfe7854f_m5m1jnuddevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:10:41 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Converted 112.00 MB image at 61.47 MB/s Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:41 devstack sudo[111057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c 1G Jun 27 20:10:41 devstack sudo[111057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:41 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-689a7f44-72dd-4e62-a1fc-df2053217d4c" returned: 0 in 0.662s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-quobyte-689a7f44-72dd-4e62-a1fc-df2053217d4c" released by "delete_volume" :: held 1.521s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=89,cinder:UPDATE=98,cinder:DELETE=9,cinder:INSERT=21 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=72,cinder:INSERT=30,cinder:UPDATE=96,cinder:DELETE=6 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Created reservations ['49cd96d3-d29c-4fec-a744-5acbf977bce5', '685769be-b382-451b-91d3-40f7ee5c36b6', '131a9300-9daf-459e-8b8a-e49a3f8073ba', 'dfb84671-82fb-4c7e-9fcf-295b23a12efe'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:41 devstack sudo[111062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:10:41 devstack sudo[111062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:41 devstack sudo[111057]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c 1G" returned: 0 in 0.692s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28365d32-316b-4be9-b1e5-c6d600588845]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:41 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:10:41 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:42 devstack sudo[111062]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.704s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:42 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:10:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Deleted volume successfully. Jun 27 20:10:42 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-077b6416-784f-430c-92bf-5aafc375ede4 tempest-VolumesSnapshotListTestJSON-1351992499 None] Lock "cinder-689a7f44-72dd-4e62-a1fc-df2053217d4c-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:10:42 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 0.754s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:42 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:10:42 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:43 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 1 in 0.825s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Downloaded image 45e3a23f-5037-4170-820b-7e6bcfe7854f ((None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}])) to volume 71aa9322-6554-414b-941c-fd9234abef2c successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Temporary image 45e3a23f-5037-4170-820b-7e6bcfe7854f for user ae4131f2938d4689896019dcc98a80c3 is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Marking volume 71aa9322-6554-414b-941c-fd9234abef2c as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Copying metadata from image 45e3a23f-5037-4170-820b-7e6bcfe7854f to 71aa9322-6554-414b-941c-fd9234abef2c. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Creating volume glance metadata for volume 71aa9322-6554-414b-941c-fd9234abef2c backed by image 45e3a23f-5037-4170-820b-7e6bcfe7854f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9e631c-07d9-4242-86f0-49c9e22c6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71aa9322-6554-414b-941c-fd9234abef2c', 'volume_size': 1, 'image_id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45e3a23f-5037-4170-820b-7e6bcfe7854f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '363f53b6935e4fdf8da2898bd0eb0549', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '45e3a23f-5037-4170-820b-7e6bcfe7854f', 'created_at': datetime.datetime(2026, 6, 27, 17, 46, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 17, 46, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45e3a23f-5037-4170-820b-7e6bcfe7854f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c217c9f-251b-47dc-8bdd-92cb6f7fe102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:43 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Volume volume-71aa9322-6554-414b-941c-fd9234abef2c (71aa9322-6554-414b-941c-fd9234abef2c): created successfully Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c217c9f-251b-47dc-8bdd-92cb6f7fe102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Flow 'volume_create_manager' (6cbb3ecf-06b9-4818-9a43-6ee2401032d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:43 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9c6e78d1-019a-4b46-9771-cadddb217654 tempest-TestShelveInstance-1276622139 None] Created volume successfully. Jun 27 20:10:44 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (f44d3a3e-3156-40f7-ba7a-4a88387b008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94df4f12-716f-4e97-8b5b-f6545e41eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94df4f12-716f-4e97-8b5b-f6545e41eecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6591314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969219db-3172-4e85-80b0-8d471e964e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:45Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1246405d-7804-43ab-89d2-c396314c7e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1246405d-7804-43ab-89d2-c396314c7e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dff0f7b-f717-42ba-b10b-2cbc0f5e70b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dff0f7b-f717-42ba-b10b-2cbc0f5e70b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969219db-3172-4e85-80b0-8d471e964e8a', 'volume_name': 'volume-969219db-3172-4e85-80b0-8d471e964e8a', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d09cd5-7892-4db1-9c82-64149cdbcc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d09cd5-7892-4db1-9c82-64149cdbcc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0973fca6-1e77-4d4f-9a09-c05b680aa4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume 969219db-3172-4e85-80b0-8d471e964e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969219db-3172-4e85-80b0-8d471e964e8a', 'volume_size': 1} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6591314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969219db-3172-4e85-80b0-8d471e964e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:45Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating volume 969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:45 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:45 devstack sudo[111076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a 1073741824 Jun 27 20:10:45 devstack sudo[111076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:45 devstack sudo[111076]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a 1073741824" returned: 0 in 0.859s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:45 devstack sudo[111085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a Jun 27 20:10:45 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:46 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a" returned: 0 in 0.648s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0973fca6-1e77-4d4f-9a09-c05b680aa4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969219db-3172-4e85-80b0-8d471e964e8a', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a9409a-11ca-49ea-8468-aa11e3fb581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:46 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume volume-969219db-3172-4e85-80b0-8d471e964e8a (969219db-3172-4e85-80b0-8d471e964e8a): created successfully Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a9409a-11ca-49ea-8468-aa11e3fb581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (f44d3a3e-3156-40f7-ba7a-4a88387b008f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:46 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9224858e-f1a0-4069-843b-7f0f3fe2f722 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created volume successfully. Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating offline snapshot fb77506d-60e9-4113-bd6c-4b0f4d4c9fef of volume 969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d0b414-4d39-417d-acf4-d9757a334fb4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:47 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a Jun 27 20:10:47 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:47 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a" returned: 0 in 0.755s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:48 devstack sudo[111093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef 1G Jun 27 20:10:48 devstack sudo[111093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:48 devstack sudo[111093]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef 1G" returned: 0 in 0.771s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969219db-3172-4e85-80b0-8d471e964e8a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:48 devstack sudo[111098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969219db-3172-4e85-80b0-8d471e964e8a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef Jun 27 20:10:48 devstack sudo[111098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:49 devstack sudo[111098]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969219db-3172-4e85-80b0-8d471e964e8a -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" returned: 0 in 0.706s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:49 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef is being set with open permissions: ugo+rw Jun 27 20:10:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:49 devstack sudo[111103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef Jun 27 20:10:49 devstack sudo[111103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:50 devstack sudo[111103]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" returned: 0 in 0.663s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:50 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info Jun 27 20:10:50 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:50 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info" returned: 0 in 0.728s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:50 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info is being set with open permissions: ugo+rw Jun 27 20:10:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:50 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info Jun 27 20:10:50 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:51 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.info" returned: 0 in 0.669s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-218eacde-4515-4fbf-a194-eba634dd3708 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Create snapshot completed successfully Jun 27 20:10:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:51 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff11806-0334-4745-bfd4-9a788d3b3081]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:10:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:51 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:10:51 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:52 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 0.820s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:52 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:10:52 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (84a20242-a7d0-4dd7-8f6d-85556a1fa4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac23821-3f6b-418a-b204-cca065e98f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac23821-3f6b-418a-b204-cca065e98f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476491230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11287980-6865-4fc5-9acb-e2ee81a2672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:53Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f45d9a-243c-432b-a69c-61c0393480a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f45d9a-243c-432b-a69c-61c0393480a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6498c931-111f-4f90-b03b-b202627cd194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6498c931-111f-4f90-b03b-b202627cd194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11287980-6865-4fc5-9acb-e2ee81a2672e', 'volume_name': 'volume-11287980-6865-4fc5-9acb-e2ee81a2672e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe0114-a570-4a16-ab6a-fb8e146b00d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe0114-a570-4a16-ab6a-fb8e146b00d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1cfc8a-d6a7-441c-ba4d-0074c460da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:52 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume 11287980-6865-4fc5-9acb-e2ee81a2672e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11287980-6865-4fc5-9acb-e2ee81a2672e', 'volume_size': 1} Jun 27 20:10:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (ac188ffd-6269-4ce9-937a-249948cb919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e2fc3c-d4eb-4749-802c-e5d49ac7137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e2fc3c-d4eb-4749-802c-e5d49ac7137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906418418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dd7bb5-c653-4b9d-838d-eaee675e7371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:53Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfc568b-f67c-4e7e-86c3-4d05b745804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfc568b-f67c-4e7e-86c3-4d05b745804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48794ec-a175-4cc9-9598-d923824d60e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48794ec-a175-4cc9-9598-d923824d60e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55dd7bb5-c653-4b9d-838d-eaee675e7371', 'volume_name': 'volume-55dd7bb5-c653-4b9d-838d-eaee675e7371', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f1d52d-7ee1-4640-85ab-3d7a861df81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f1d52d-7ee1-4640-85ab-3d7a861df81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd40d3a-efe8-4978-af8f-ce32f71bd12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume 55dd7bb5-c653-4b9d-838d-eaee675e7371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55dd7bb5-c653-4b9d-838d-eaee675e7371', 'volume_size': 1} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 1 in 0.824s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.682s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476491230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11287980-6865-4fc5-9acb-e2ee81a2672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:53Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating volume 11287980-6865-4fc5-9acb-e2ee81a2672e {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:53 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:53 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e 1073741824 Jun 27 20:10:53 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-71aa9322-6554-414b-941c-fd9234abef2c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f2d1e93-9454-4586-84e1-8b9aee1ca27a', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:10:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-d2f9ba42-27d6-4b0b-96fd-08d7f45f6c83 req-370d90f5-b215-4a0b-8eb3-ebe92fe748b5 tempest-TestShelveInstance-1276622139 None] attachment_update completed successfully. Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (64ce5add-3b17-4b48-ada0-6cc600010e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c078e811-5ed4-41de-abba-972f46628992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c078e811-5ed4-41de-abba-972f46628992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434010661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3309db26-4f28-43b1-98e6-2e70fd339f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:54Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a40da4-f6a4-468d-b4c4-6e62963aa8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a40da4-f6a4-468d-b4c4-6e62963aa8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbb1242-fb95-46f5-908d-585255415e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbb1242-fb95-46f5-908d-585255415e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3309db26-4f28-43b1-98e6-2e70fd339f68', 'volume_name': 'volume-3309db26-4f28-43b1-98e6-2e70fd339f68', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e8f7e8-f489-4195-a06f-2e4facef15b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e8f7e8-f489-4195-a06f-2e4facef15b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ee2921-9177-4b81-8b01-0bf38502ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume 3309db26-4f28-43b1-98e6-2e70fd339f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3309db26-4f28-43b1-98e6-2e70fd339f68', 'volume_size': 1} Jun 27 20:10:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (34fd43b4-765f-4823-927a-5c9daec17143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0f0912-7fd1-49fd-9ef1-f846dab1d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0f0912-7fd1-49fd-9ef1-f846dab1d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76317326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c455e034-9d78-4515-b42b-72d369b962e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:54Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389f69d1-1591-4601-8c0a-efa9d5728ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389f69d1-1591-4601-8c0a-efa9d5728ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c77a692-0fdf-48eb-a312-c574a89bfebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c77a692-0fdf-48eb-a312-c574a89bfebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c455e034-9d78-4515-b42b-72d369b962e9', 'volume_name': 'volume-c455e034-9d78-4515-b42b-72d369b962e9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87357f0-2e95-4afe-9452-5ce91dcc10f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87357f0-2e95-4afe-9452-5ce91dcc10f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4be493-f161-4afd-b2b0-6f8895787c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume c455e034-9d78-4515-b42b-72d369b962e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c455e034-9d78-4515-b42b-72d369b962e9', 'volume_size': 1} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (d793317a-288e-4d7b-8d89-3c991208c196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895d971-ee30-4dc3-a114-dea984634f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895d971-ee30-4dc3-a114-dea984634f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1202020562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c77c61-4228-4915-90f3-f5b5c1f37cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:54Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe52b71-0b28-4187-9ed9-225c25387f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe52b71-0b28-4187-9ed9-225c25387f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa2fb35-717f-4842-b4d0-5d0e55940aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa2fb35-717f-4842-b4d0-5d0e55940aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c77c61-4228-4915-90f3-f5b5c1f37cf9', 'volume_name': 'volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe5e484-1a90-4f53-9208-43b70c78e947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe5e484-1a90-4f53-9208-43b70c78e947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c49e93c-7ff6-4e4f-9ecd-27257f7316cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:54 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume 35c77c61-4228-4915-90f3-f5b5c1f37cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9', 'volume_size': 1} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:54 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e 1073741824" returned: 0 in 1.204s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:54 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e Jun 27 20:10:54 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:55 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e" returned: 0 in 0.661s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.914s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906418418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dd7bb5-c653-4b9d-838d-eaee675e7371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:53Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating volume 55dd7bb5-c653-4b9d-838d-eaee675e7371 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:55 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1cfc8a-d6a7-441c-ba4d-0074c460da51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11287980-6865-4fc5-9acb-e2ee81a2672e', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e34649-b8f2-4b24-903e-686b88f03358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:55 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 1073741824 Jun 27 20:10:55 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:55 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume volume-11287980-6865-4fc5-9acb-e2ee81a2672e (11287980-6865-4fc5-9acb-e2ee81a2672e): created successfully Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e34649-b8f2-4b24-903e-686b88f03358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:55 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (84a20242-a7d0-4dd7-8f6d-85556a1fa4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:55 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3fe4582c-3796-444c-ab57-f84ea14492ac tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created volume successfully. Jun 27 20:10:56 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 1073741824" returned: 0 in 0.858s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:56 devstack sudo[111214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 Jun 27 20:10:56 devstack sudo[111214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:56 devstack sudo[111214]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371" returned: 0 in 0.660s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.036s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434010661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3309db26-4f28-43b1-98e6-2e70fd339f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:54Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating volume 3309db26-4f28-43b1-98e6-2e70fd339f68 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:56 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:56 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 1073741824 Jun 27 20:10:56 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd40d3a-efe8-4978-af8f-ce32f71bd12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dd7bb5-c653-4b9d-838d-eaee675e7371', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc791e84-9ad8-4790-8636-be4ad32ae548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:56 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 (55dd7bb5-c653-4b9d-838d-eaee675e7371): created successfully Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc791e84-9ad8-4790-8636-be4ad32ae548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (ac188ffd-6269-4ce9-937a-249948cb919b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-72b32190-246b-4612-9c77-5bcb824832d5 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created volume successfully. Jun 27 20:10:57 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 1073741824" returned: 0 in 0.821s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:57 devstack sudo[111226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 Jun 27 20:10:57 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:58 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68" returned: 0 in 0.645s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.102s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76317326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c455e034-9d78-4515-b42b-72d369b962e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:54Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating volume c455e034-9d78-4515-b42b-72d369b962e9 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:10:58 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ee2921-9177-4b81-8b01-0bf38502ee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3309db26-4f28-43b1-98e6-2e70fd339f68', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5862c307-376c-497e-b102-2a409b3f47fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:10:58 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 1073741824 Jun 27 20:10:58 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:10:58 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume volume-3309db26-4f28-43b1-98e6-2e70fd339f68 (3309db26-4f28-43b1-98e6-2e70fd339f68): created successfully Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5862c307-376c-497e-b102-2a409b3f47fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:10:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (64ce5add-3b17-4b48-ada0-6cc600010e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:10:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4633f588-72df-46d5-9e4e-e98c470c2e21 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created volume successfully. Jun 27 20:10:59 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Jun 27 20:10:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 1073741824" returned: 0 in 1.070s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:10:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:10:59 devstack sudo[111607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 Jun 27 20:10:59 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:00 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.691s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1202020562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c77c61-4228-4915-90f3-f5b5c1f37cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaeb7418b9140119bf44a90596a188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:10:54Z,use_quota=True,user_id='ccf4949d1a25428f8cfd60ccccaba2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Creating volume 35c77c61-4228-4915-90f3-f5b5c1f37cf9 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:11:00 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:00 devstack sudo[111627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 1073741824 Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4be493-f161-4afd-b2b0-6f8895787c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c455e034-9d78-4515-b42b-72d369b962e9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:00 devstack sudo[111627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6c3ec7-ad8d-4be0-88b5-2e4ef52b9d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:00 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume volume-c455e034-9d78-4515-b42b-72d369b962e9 (c455e034-9d78-4515-b42b-72d369b962e9): created successfully Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6c3ec7-ad8d-4be0-88b5-2e4ef52b9d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (34fd43b4-765f-4823-927a-5c9daec17143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0fadfce4-f9cd-43f7-8608-e7f9d53f1f39 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created volume successfully. Jun 27 20:11:01 devstack sudo[111627]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 1073741824" returned: 0 in 0.907s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:01 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 Jun 27 20:11:01 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:01 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9" returned: 0 in 0.707s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c49e93c-7ff6-4e4f-9ecd-27257f7316cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d70bf58-2aa8-405d-b06d-a87a06acea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Volume volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 (35c77c61-4228-4915-90f3-f5b5c1f37cf9): created successfully Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d70bf58-2aa8-405d-b06d-a87a06acea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Flow 'volume_create_manager' (d793317a-288e-4d7b-8d89-3c991208c196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:01 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-46a1a805-24aa-4137-abf1-a4d6514059e7 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created volume successfully. Jun 27 20:11:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-35c77c61-4228-4915-90f3-f5b5c1f37cf9-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-35c77c61-4228-4915-90f3-f5b5c1f37cf9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-35c77c61-4228-4915-90f3-f5b5c1f37cf9" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-35c77c61-4228-4915-90f3-f5b5c1f37cf9" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:02 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e5397-467d-4b84-814f-bd9256e36535]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:02 devstack sudo[111638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 Jun 27 20:11:02 devstack sudo[111638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:03 devstack sudo[111638]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9" returned: 0 in 0.815s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:03 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9 Jun 27 20:11:03 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:03 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-35c77c61-4228-4915-90f3-f5b5c1f37cf9" returned: 0 in 0.708s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-35c77c61-4228-4915-90f3-f5b5c1f37cf9" released by "delete_volume" :: held 1.581s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:03 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['99a15f79-5de9-4425-9117-0f24764741c1', 'dc91371f-57c0-4278-8e77-792540109b8a', '95ec76af-a9e1-42ce-819e-989b9b031d6f', '95339b9f-f8d8-4399-9899-d502e9f5ceb9'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:04 devstack sudo[111648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:04 devstack sudo[111648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-c455e034-9d78-4515-b42b-72d369b962e9-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-c455e034-9d78-4515-b42b-72d369b962e9-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-c455e034-9d78-4515-b42b-72d369b962e9" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-c455e034-9d78-4515-b42b-72d369b962e9" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6309594-5a60-49de-9d84-eddebd4e654c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:04 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 Jun 27 20:11:04 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:04 devstack sudo[111648]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.857s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:04 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleted volume successfully. Jun 27 20:11:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2567b5aa-c57e-4296-88c3-316f6ac52806 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-35c77c61-4228-4915-90f3-f5b5c1f37cf9-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:05 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9" returned: 0 in 0.851s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:05 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9 Jun 27 20:11:05 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:06 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c455e034-9d78-4515-b42b-72d369b962e9" returned: 0 in 0.658s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-c455e034-9d78-4515-b42b-72d369b962e9" released by "delete_volume" :: held 1.568s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['c218e871-ba1f-4a06-8b95-5a6b3d2f691a', 'e952c4f3-2f2b-4890-ac39-d492f781a64d', '34ec3c87-3db2-40eb-8481-b8b7c2e2fc73', '4d1229cf-637d-447a-9a64-c9041d5898c5'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:06 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:06 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-3309db26-4f28-43b1-98e6-2e70fd339f68-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-3309db26-4f28-43b1-98e6-2e70fd339f68-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-3309db26-4f28-43b1-98e6-2e70fd339f68" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-3309db26-4f28-43b1-98e6-2e70fd339f68" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c7ffc6-bbae-4f6c-a92b-ed8c9ab0857f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:07 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.708s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleted volume successfully. Jun 27 20:11:07 devstack sudo[111667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 Jun 27 20:11:07 devstack sudo[111667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4012dc1f-e0b9-4756-ac0c-c622a076e3c1 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-c455e034-9d78-4515-b42b-72d369b962e9-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:07 devstack sudo[111667]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68" returned: 0 in 0.758s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:07 devstack sudo[111675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68 Jun 27 20:11:07 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:08 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3309db26-4f28-43b1-98e6-2e70fd339f68" returned: 0 in 0.680s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-3309db26-4f28-43b1-98e6-2e70fd339f68" released by "delete_volume" :: held 1.483s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['fd395982-5069-4d18-beb2-74b9958bf09f', 'b436eda7-775c-46a2-a7c8-af2dc792f1ba', 'b45b8931-ac72-42e0-8a8b-2987ab8c8cda', '4d27693a-bf25-4155-9758-dbf352e5d108'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:08 devstack sudo[111681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:08 devstack sudo[111681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-55dd7bb5-c653-4b9d-838d-eaee675e7371-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-55dd7bb5-c653-4b9d-838d-eaee675e7371-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-55dd7bb5-c653-4b9d-838d-eaee675e7371" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-55dd7bb5-c653-4b9d-838d-eaee675e7371" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf6631d-05ef-4089-8d9c-7ae582f5931f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:09 devstack sudo[111681]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleted volume successfully. Jun 27 20:11:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-f55ab94f-dff3-4d7a-8097-896d235de622 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-3309db26-4f28-43b1-98e6-2e70fd339f68-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:09 devstack sudo[111684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 Jun 27 20:11:09 devstack sudo[111684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:10 devstack sudo[111684]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371" returned: 0 in 0.746s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:10 devstack sudo[111689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371 Jun 27 20:11:10 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:10 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-55dd7bb5-c653-4b9d-838d-eaee675e7371" returned: 0 in 0.672s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-55dd7bb5-c653-4b9d-838d-eaee675e7371" released by "delete_volume" :: held 1.468s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['cac3a303-7db3-4933-b109-6796185a91d7', 'd3ee61a6-b850-4456-8ab8-43f1f9a412d9', 'a55223c7-01c4-4a5c-93e4-733f99fb6ba8', '8772c1e2-9223-42fe-b94c-ceecb07dd832'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:10 devstack sudo[111693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:10 devstack sudo[111693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-11287980-6865-4fc5-9acb-e2ee81a2672e-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-11287980-6865-4fc5-9acb-e2ee81a2672e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-11287980-6865-4fc5-9acb-e2ee81a2672e" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-11287980-6865-4fc5-9acb-e2ee81a2672e" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[55669deb-e16b-4566-bcc0-dc041b2a1a92]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:11 devstack sudo[111693]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleted volume successfully. Jun 27 20:11:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-90b8a975-fc38-4a97-9a90-f1f4bb51b047 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-55dd7bb5-c653-4b9d-838d-eaee675e7371-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:11 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e Jun 27 20:11:11 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:12 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e" returned: 0 in 0.807s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:12 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e Jun 27 20:11:12 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:13 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-11287980-6865-4fc5-9acb-e2ee81a2672e" returned: 0 in 0.690s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-11287980-6865-4fc5-9acb-e2ee81a2672e" released by "delete_volume" :: held 1.546s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['4b2af61b-48ff-4292-a5e6-7afab2d42190', 'ae3feda6-9182-479e-b099-48d77dc32d19', 'd4aa2dd1-8e1f-4bc9-a38f-8ccc5882ebc7', '5fe36d8c-43ca-4c40-932f-0be7e4de7992'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:13 devstack sudo[111705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:13 devstack sudo[111705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-fb77506d-60e9-4113-bd6c-4b0f4d4c9fef-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-fb77506d-60e9-4113-bd6c-4b0f4d4c9fef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-969219db-3172-4e85-80b0-8d471e964e8a" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-969219db-3172-4e85-80b0-8d471e964e8a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleting offline snapshot fb77506d-60e9-4113-bd6c-4b0f4d4c9fef of volume 969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] snapshot_file for this snap is: volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8b56a6-3c70-41c8-899a-bc64e343dc0c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:13 devstack sudo[111705]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.717s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:13 devstack sudo[111708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef Jun 27 20:11:13 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleted volume successfully. Jun 27 20:11:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-adf444d7-c576-4d4d-96d1-0b0097f1785a tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-11287980-6865-4fc5-9acb-e2ee81a2672e-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:14 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" returned: 0 in 0.785s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969219db-3172-4e85-80b0-8d471e964e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:11:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f4b9c6-3088-4ce5-986c-3357787a6dac]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:14 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a Jun 27 20:11:14 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:15 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a" returned: 0 in 0.817s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:15 devstack sudo[111796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef Jun 27 20:11:15 devstack sudo[111796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:16 devstack sudo[111796]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" returned: 0 in 0.738s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:16 devstack sudo[111826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef Jun 27 20:11:16 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:16 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:16 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:16 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a.fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" returned: 0 in 0.656s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:16 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.648s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-fb77506d-60e9-4113-bd6c-4b0f4d4c9fef" released by "_delete_snapshot" :: held 3.139s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-969219db-3172-4e85-80b0-8d471e964e8a" released by "delete_snapshot" :: held 3.166s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['2fc1527c-4808-4219-a60e-1af1d1279fcd', '49053938-2f16-4a33-a926-44af33136d44', 'e89581d3-09da-4dca-8dc3-89f81264d38c', '2677323c-fe30-43c1-9c1f-c524140d34d7'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Delete snapshot completed successfully. Jun 27 20:11:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2c0c6416-a8d9-4709-bd8c-0dc8e5935e9d tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-fb77506d-60e9-4113-bd6c-4b0f4d4c9fef-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-969219db-3172-4e85-80b0-8d471e964e8a-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-969219db-3172-4e85-80b0-8d471e964e8a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "cinder-quobyte-969219db-3172-4e85-80b0-8d471e964e8a" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-969219db-3172-4e85-80b0-8d471e964e8a" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:18 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a39948-6174-46a0-874a-c59f4c6ad26f]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:18 devstack sudo[111832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a Jun 27 20:11:18 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:18 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:18 devstack sudo[111837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a Jun 27 20:11:18 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:19 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-969219db-3172-4e85-80b0-8d471e964e8a" returned: 0 in 0.656s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-quobyte-969219db-3172-4e85-80b0-8d471e964e8a" released by "delete_volume" :: held 1.447s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Created reservations ['5bbe57b9-929a-4693-b558-58c71d895fcf', '53287c5c-19af-425d-a21c-8bb51d1ef561', 'f018d35f-2410-4fbb-b330-f518a5f40953', '1643de1b-8ca7-423d-a8e9-88eb120664c4'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:19 devstack sudo[111840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:19 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:20 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.640s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:20 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Deleted volume successfully. Jun 27 20:11:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-0588977e-fea4-4dab-82b2-2690fdbccb44 tempest-CreateVolumesFromSnapshotTest-1741953962 None] Lock "cinder-969219db-3172-4e85-80b0-8d471e964e8a-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:24 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:11:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Flow 'volume_create_manager' (12b78047-0222-49fc-90bb-d8e3d43d0b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:24 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55010e3-a823-44f0-8b6c-450da13f407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55010e3-a823-44f0-8b6c-450da13f407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb422dee-82d8-4562-ba9c-f3275b4f63b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6cd8c6daf345f8b96e69f2fe7989d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:11:25Z,use_quota=True,user_id='dd1f59f9e807413c83065e435e148c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1990ebe-e011-48aa-bfee-48c90bd302a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1990ebe-e011-48aa-bfee-48c90bd302a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac8104b-267e-4666-bf94-5996340b3e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac8104b-267e-4666-bf94-5996340b3e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb422dee-82d8-4562-ba9c-f3275b4f63b7', 'volume_name': 'volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7', 'volume_size': 1, 'image_id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a6884bb-3516-4e94-9cbf-ef32af42046d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a47107cd2c9c372757c9a6a5b7948e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee6cd8c6daf345f8b96e69f2fe7989d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab1c5689fe83ed904a0e60e5307f1c90b61e7fc7232fb92fa641d21d77168a8bc917bb6a37c2482d5a8e384f95469c7630454c971f930b439008791f82ec32ad', 'id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'created_at': datetime.datetime(2026, 6, 27, 18, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a6884bb-3516-4e94-9cbf-ef32af42046d/file', 'properties': {}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f648eaf-cdf4-4c83-8f77-96b52dd9a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f648eaf-cdf4-4c83-8f77-96b52dd9a84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea7e352-08ea-4731-bc02-a33c7479bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:25 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Volume cb422dee-82d8-4562-ba9c-f3275b4f63b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7', 'volume_size': 1, 'image_id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a6884bb-3516-4e94-9cbf-ef32af42046d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a47107cd2c9c372757c9a6a5b7948e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee6cd8c6daf345f8b96e69f2fe7989d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab1c5689fe83ed904a0e60e5307f1c90b61e7fc7232fb92fa641d21d77168a8bc917bb6a37c2482d5a8e384f95469c7630454c971f930b439008791f82ec32ad', 'id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'created_at': datetime.datetime(2026, 6, 27, 18, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a6884bb-3516-4e94-9cbf-ef32af42046d/file', 'properties': {}}, 'image_service': } Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Trying to clone cb422dee-82d8-4562-ba9c-f3275b4f63b7 from image 3a6884bb-3516-4e94-9cbf-ef32af42046d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a6884bb-3516-4e94-9cbf-ef32af42046d', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:11:25 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Image download 0.00 MB at 0.00 MB/s Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b410cc-fbf3-4962-b128-360ac8ac2ee5]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:25 devstack sudo[111851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD Jun 27 20:11:25 devstack sudo[111851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:26 devstack sudo[111851]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:26 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:26 devstack sudo[111855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD Jun 27 20:11:26 devstack sudo[111855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:27 devstack sudo[111855]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD" returned: 1 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Temporary image 3a6884bb-3516-4e94-9cbf-ef32af42046d is fetched for user dd1f59f9e807413c83065e435e148c10. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605b686-64bd-4831-8b14-903659be56de]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:27 devstack sudo[111860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD Jun 27 20:11:27 devstack sudo[111860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:27 devstack sudo[111860]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:28 devstack sudo[111904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD Jun 27 20:11:28 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:28 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD" returned: 1 in 0.721s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb422dee-82d8-4562-ba9c-f3275b4f63b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6cd8c6daf345f8b96e69f2fe7989d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:11:25Z,use_quota=True,user_id='dd1f59f9e807413c83065e435e148c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Creating volume cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:11:28 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:11:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:28 devstack sudo[111909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 1073741824 Jun 27 20:11:28 devstack sudo[111909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:29 devstack sudo[111909]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 1073741824" returned: 0 in 0.820s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:29 devstack sudo[111914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:29 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:30 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:11:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:30 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Attempting download of 3a6884bb-3516-4e94-9cbf-ef32af42046d ((None, [{'url': 'file:///opt/stack/data/glance/images/3a6884bb-3516-4e94-9cbf-ef32af42046d', 'metadata': {}}])) to volume cb422dee-82d8-4562-ba9c-f3275b4f63b7. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:11:30 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de551e42-d776-49d3-991b-ddade5685934]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:30 devstack sudo[111919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo Jun 27 20:11:30 devstack sudo[111919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:31 devstack sudo[111919]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo" returned: 0 in 0.856s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:31 devstack sudo[111961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo Jun 27 20:11:31 devstack sudo[111961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-6a524a74-74cf-461b-be33-d44f2b68611a req-703eaf9b-72f3-4616-a5cc-8809c426dfc2 tempest-TestShelveInstance-1276622139 None] Terminate volume connection completed successfully. Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-6a524a74-74cf-461b-be33-d44f2b68611a req-703eaf9b-72f3-4616-a5cc-8809c426dfc2 tempest-TestShelveInstance-1276622139 None] Deleting attachment 1f2d1e93-9454-4586-84e1-8b9aee1ca27a. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:11:31 devstack sudo[111961]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo" returned: 1 in 0.738s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a6884bb-3516-4e94-9cbf-ef32af42046d_qatrguyo' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2065b886-171d-46f4-9dd6-6f654e955682]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:32 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD Jun 27 20:11:32 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:32 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:32 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD Jun 27 20:11:32 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:33 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD" returned: 1 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:33 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] 3a6884bb-3516-4e94-9cbf-ef32af42046d was raw, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:11:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:33 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:33 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:34 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 0 in 0.785s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:34 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a6884bb-3516-4e94-9cbf-ef32af42046d_rv6wd5vwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:11:34 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 20:11:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:34 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 1G Jun 27 20:11:34 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:35 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 1G" returned: 0 in 0.737s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:35 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa63b85c-66d7-4de0-8e82-a2e585fe5f0a]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:35 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:35 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:35 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 0 in 0.752s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:35 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:35 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:36 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 1 in 0.777s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Downloaded image 3a6884bb-3516-4e94-9cbf-ef32af42046d ((None, [{'url': 'file:///opt/stack/data/glance/images/3a6884bb-3516-4e94-9cbf-ef32af42046d', 'metadata': {}}])) to volume cb422dee-82d8-4562-ba9c-f3275b4f63b7 successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Temporary image 3a6884bb-3516-4e94-9cbf-ef32af42046d for user dd1f59f9e807413c83065e435e148c10 is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Marking volume cb422dee-82d8-4562-ba9c-f3275b4f63b7 as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Copying metadata from image 3a6884bb-3516-4e94-9cbf-ef32af42046d to cb422dee-82d8-4562-ba9c-f3275b4f63b7. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Creating volume glance metadata for volume cb422dee-82d8-4562-ba9c-f3275b4f63b7 backed by image 3a6884bb-3516-4e94-9cbf-ef32af42046d with: {'image_id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0a47107cd2c9c372757c9a6a5b7948e8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea7e352-08ea-4731-bc02-a33c7479bea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7', 'volume_size': 1, 'image_id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a6884bb-3516-4e94-9cbf-ef32af42046d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a47107cd2c9c372757c9a6a5b7948e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee6cd8c6daf345f8b96e69f2fe7989d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab1c5689fe83ed904a0e60e5307f1c90b61e7fc7232fb92fa641d21d77168a8bc917bb6a37c2482d5a8e384f95469c7630454c971f930b439008791f82ec32ad', 'id': '3a6884bb-3516-4e94-9cbf-ef32af42046d', 'created_at': datetime.datetime(2026, 6, 27, 18, 11, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 11, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a6884bb-3516-4e94-9cbf-ef32af42046d/file', 'properties': {}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9253aa-b251-4608-806a-3a25fc524acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:36 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Volume volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 (cb422dee-82d8-4562-ba9c-f3275b4f63b7): created successfully Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9253aa-b251-4608-806a-3a25fc524acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Flow 'volume_create_manager' (12b78047-0222-49fc-90bb-d8e3d43d0b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[514743af-1837-4e53-8efc-22888fad594b]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:36 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-739acb4b-8bd8-4399-82b9-1fa897c0b6ef tempest-VolumeImageDependencyTests-1183149148 None] Created volume successfully. Jun 27 20:11:36 devstack sudo[112005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:11:36 devstack sudo[112005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:37 devstack sudo[112005]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 0.747s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:37 devstack sudo[112009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:11:37 devstack sudo[112009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Acquiring lock "cinder-cb422dee-82d8-4562-ba9c-f3275b4f63b7-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Lock "cinder-cb422dee-82d8-4562-ba9c-f3275b4f63b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Acquiring lock "cinder-quobyte-cb422dee-82d8-4562-ba9c-f3275b4f63b7" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Lock "cinder-quobyte-cb422dee-82d8-4562-ba9c-f3275b4f63b7" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781edb0-38e8-48c4-a3bd-f2eaeece6cb0]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:37 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:37 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:38 devstack sudo[112009]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 1 in 0.813s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.621s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-71aa9322-6554-414b-941c-fd9234abef2c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bb3c7c7-8f8c-451e-85b7-45f175824cc0', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:11:38 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-b1c3ea42-fabc-4ec0-9664-b12905357fce req-b725df0e-e420-4458-9adc-5f56f284eb22 tempest-TestShelveInstance-1276622139 None] attachment_update completed successfully. Jun 27 20:11:38 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 0 in 0.769s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:38 devstack sudo[112018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:38 devstack sudo[112018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:39 devstack sudo[112018]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 1 in 0.765s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:11:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:39 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7 Jun 27 20:11:39 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:40 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-cb422dee-82d8-4562-ba9c-f3275b4f63b7" returned: 0 in 0.625s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Lock "cinder-quobyte-cb422dee-82d8-4562-ba9c-f3275b4f63b7" released by "delete_volume" :: held 2.219s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Created reservations ['d4e82d8e-30b1-405b-bd83-251d770f434a', 'a8f25c96-d0b4-4cdb-ae1b-d5b1906433ae', 'bb4070ba-5e3f-4c34-ada4-3a4470ea7a26', '20b125be-946f-49ed-90c4-782bb1734557'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:40 devstack sudo[112026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:11:40 devstack sudo[112026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:40 devstack sudo[112026]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.630s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:11:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Deleted volume successfully. Jun 27 20:11:40 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-76aaf028-458a-4f3a-9e59-717eac1f8bdc tempest-VolumeImageDependencyTests-1183149148 None] Lock "cinder-cb422dee-82d8-4562-ba9c-f3275b4f63b7-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=93,cinder:SELECT=78,cinder:DELETE=10,cinder:INSERT=35 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=93,cinder:INSERT=30,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Flow 'volume_create_manager' (81f0c7a4-cb82-454e-a488-fd3d9c8d3c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62862bd5-39af-4d07-9427-09d2fd7bbce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62862bd5-39af-4d07-9427-09d2fd7bbce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be5b87e-b788-4e7f-97f7-98ba2d8bf651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1a8fc76714d3cb0944d91680f6a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:11:44Z,use_quota=True,user_id='bf2056cf8b4248dcb155a8e76abcd8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755a0bdc-d0df-401b-a21c-72b254500f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755a0bdc-d0df-401b-a21c-72b254500f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cc490e-3033-4375-b2cc-bc756c4d5fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cc490e-3033-4375-b2cc-bc756c4d5fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be5b87e-b788-4e7f-97f7-98ba2d8bf651', 'volume_name': 'volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d5ef32-db70-491c-b452-40ac17376e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d5ef32-db70-491c-b452-40ac17376e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97da1488-7eaa-4540-98f9-13fc861383f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:44 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Volume 1be5b87e-b788-4e7f-97f7-98ba2d8bf651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651', 'volume_size': 1} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be5b87e-b788-4e7f-97f7-98ba2d8bf651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1a8fc76714d3cb0944d91680f6a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:11:44Z,use_quota=True,user_id='bf2056cf8b4248dcb155a8e76abcd8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Creating volume 1be5b87e-b788-4e7f-97f7-98ba2d8bf651 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:11:44 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:11:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:44 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 1073741824 Jun 27 20:11:44 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:45 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 1073741824" returned: 0 in 0.854s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:45 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 Jun 27 20:11:45 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:45 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651" returned: 0 in 0.647s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97da1488-7eaa-4540-98f9-13fc861383f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb00fabf-f437-4c04-96ac-d7292dfa7e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Volume volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 (1be5b87e-b788-4e7f-97f7-98ba2d8bf651): created successfully Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb00fabf-f437-4c04-96ac-d7292dfa7e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Flow 'volume_create_manager' (81f0c7a4-cb82-454e-a488-fd3d9c8d3c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0e23df4d-e87c-458e-ab0e-cc0fa685e3da tempest-CinderUnicodeTest-1329772264 None] Created volume successfully. Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Flow 'volume_create_manager' (bc9f6c01-ed97-48fd-8e13-2c585a50d09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7f81d2-e995-475d-9c85-57f942675572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7f81d2-e995-475d-9c85-57f942675572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:11:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1004874577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292c2711-be58-48b2-b8df-4719441d3bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1a8fc76714d3cb0944d91680f6a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:11:47Z,use_quota=True,user_id='bf2056cf8b4248dcb155a8e76abcd8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db6d56a-a8ea-42b6-909d-91641bc5e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db6d56a-a8ea-42b6-909d-91641bc5e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01312db4-a537-4347-8c19-b4d871d7cf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01312db4-a537-4347-8c19-b4d871d7cf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292c2711-be58-48b2-b8df-4719441d3bf7', 'volume_name': 'volume-292c2711-be58-48b2-b8df-4719441d3bf7', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ea7a6-f58b-49b9-b19a-7bd852cd25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ea7a6-f58b-49b9-b19a-7bd852cd25d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e94f7c2-6b23-4f11-b7da-6f410bc52ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:46 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Volume 292c2711-be58-48b2-b8df-4719441d3bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292c2711-be58-48b2-b8df-4719441d3bf7', 'volume_size': 1} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:11:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1004874577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292c2711-be58-48b2-b8df-4719441d3bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1a8fc76714d3cb0944d91680f6a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:11:47Z,use_quota=True,user_id='bf2056cf8b4248dcb155a8e76abcd8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Creating volume 292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:11:46 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:11:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:46 devstack sudo[112108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 1073741824 Jun 27 20:11:46 devstack sudo[112108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:47 devstack sudo[112108]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 1073741824" returned: 0 in 0.806s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:47 devstack sudo[112118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 Jun 27 20:11:47 devstack sudo[112118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:48 devstack sudo[112118]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7" returned: 0 in 0.642s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e94f7c2-6b23-4f11-b7da-6f410bc52ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292c2711-be58-48b2-b8df-4719441d3bf7', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d93ed64-1080-4945-85ca-b63c8d1188a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:11:48 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Volume volume-292c2711-be58-48b2-b8df-4719441d3bf7 (292c2711-be58-48b2-b8df-4719441d3bf7): created successfully Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d93ed64-1080-4945-85ca-b63c8d1188a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:11:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Flow 'volume_create_manager' (bc9f6c01-ed97-48fd-8e13-2c585a50d09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:11:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4fcb0803-143b-45a0-b7ef-44605997e860 tempest-CinderUnicodeTest-1329772264 None] Created volume successfully. Jun 27 20:11:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:11:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:11:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Creating offline snapshot a4c89c47-c806-44d2-8b9d-f185662872bd of volume 292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:11:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5387f897-1fb1-4743-8307-08fffa40f448]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:49 devstack sudo[112437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 Jun 27 20:11:49 devstack sudo[112437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:50 devstack sudo[112437]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7" returned: 0 in 0.902s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:50 devstack sudo[112492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd 1G Jun 27 20:11:50 devstack sudo[112492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:50 devstack sudo[112492]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd 1G" returned: 0 in 0.987s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292c2711-be58-48b2-b8df-4719441d3bf7 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:51 devstack sudo[112524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292c2711-be58-48b2-b8df-4719441d3bf7 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd Jun 27 20:11:51 devstack sudo[112524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:51 devstack sudo[112524]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292c2711-be58-48b2-b8df-4719441d3bf7 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd" returned: 0 in 0.732s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:51 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd is being set with open permissions: ugo+rw Jun 27 20:11:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:51 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd Jun 27 20:11:51 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:52 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd" returned: 0 in 0.806s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:52 devstack sudo[112534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info Jun 27 20:11:52 devstack sudo[112534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:53 devstack sudo[112534]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info" returned: 0 in 0.675s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:53 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info is being set with open permissions: ugo+rw Jun 27 20:11:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:53 devstack sudo[112537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info Jun 27 20:11:53 devstack sudo[112537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:53 devstack sudo[112537]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.info" returned: 0 in 0.651s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.854s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:11:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-29815bd9-2f6a-42c3-a0a6-de7f7a2aec9a tempest-CinderUnicodeTest-1329772264 None] Create snapshot completed successfully Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-a4c89c47-c806-44d2-8b9d-f185662872bd-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-a4c89c47-c806-44d2-8b9d-f185662872bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-quobyte-292c2711-be58-48b2-b8df-4719441d3bf7" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-292c2711-be58-48b2-b8df-4719441d3bf7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-quobyte-a4c89c47-c806-44d2-8b9d-f185662872bd" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-a4c89c47-c806-44d2-8b9d-f185662872bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Deleting offline snapshot a4c89c47-c806-44d2-8b9d-f185662872bd of volume 292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] snapshot_file for this snap is: volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca473db-3f2d-48a3-876b-d5fdc2ee0e69]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:54 devstack sudo[112541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd Jun 27 20:11:54 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:55 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd" returned: 0 in 0.817s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-292c2711-be58-48b2-b8df-4719441d3bf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:11:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14994b4d-5a80-4220-a144-8c4bcad92b1e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:55 devstack sudo[112546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 Jun 27 20:11:55 devstack sudo[112546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:56 devstack sudo[112546]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7" returned: 0 in 0.747s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:56 devstack sudo[112551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd Jun 27 20:11:56 devstack sudo[112551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:56 devstack sudo[112551]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd" returned: 0 in 0.731s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:56 devstack sudo[112556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd Jun 27 20:11:56 devstack sudo[112556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:57 devstack sudo[112556]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7.a4c89c47-c806-44d2-8b9d-f185662872bd" returned: 0 in 0.640s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-a4c89c47-c806-44d2-8b9d-f185662872bd" released by "_delete_snapshot" :: held 3.042s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-292c2711-be58-48b2-b8df-4719441d3bf7" released by "delete_snapshot" :: held 3.066s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:57 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Created reservations ['432f9bfc-70b1-49fb-a60d-a270ea51fca0', 'ba3611d8-55a3-40ef-b2ef-91237bfeaac0', '07a28bd0-e2b4-4311-998d-94d39a298b11', 'a59588a6-79e9-40d3-be08-a982fb1e49c1'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:11:57 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Delete snapshot completed successfully. Jun 27 20:11:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-fff4eafe-dd5e-41f4-a67d-1d41525410d7 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-a4c89c47-c806-44d2-8b9d-f185662872bd-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:11:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-292c2711-be58-48b2-b8df-4719441d3bf7-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-292c2711-be58-48b2-b8df-4719441d3bf7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-quobyte-292c2711-be58-48b2-b8df-4719441d3bf7" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:11:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-292c2711-be58-48b2-b8df-4719441d3bf7" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:11:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae051e-1681-4f73-856e-5dc53566dcf6]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:11:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:58 devstack sudo[112559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 Jun 27 20:11:58 devstack sudo[112559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:11:59 devstack sudo[112559]: pam_unix(sudo:session): session closed for user root Jun 27 20:11:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7" returned: 0 in 0.767s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:11:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:11:59 devstack sudo[112564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7 Jun 27 20:11:59 devstack sudo[112564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:00 devstack sudo[112564]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-292c2711-be58-48b2-b8df-4719441d3bf7" returned: 0 in 0.663s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-292c2711-be58-48b2-b8df-4719441d3bf7" released by "delete_volume" :: held 1.489s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Created reservations ['a2648e1f-5538-4eb4-8c12-b7c7357d2a55', '3e7a990e-fa7c-47c7-9f81-39b1b16fa3d6', '1470b333-e952-4144-8d35-63af2ac64a0e', 'b88ab8ed-63ef-42a6-ac7d-280f45c29541'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:00 devstack sudo[112567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:12:00 devstack sudo[112567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-1be5b87e-b788-4e7f-97f7-98ba2d8bf651-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-1be5b87e-b788-4e7f-97f7-98ba2d8bf651-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "cinder-quobyte-1be5b87e-b788-4e7f-97f7-98ba2d8bf651" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:12:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-1be5b87e-b788-4e7f-97f7-98ba2d8bf651" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:12:01 devstack sudo[112567]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.710s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd63dae-6948-47d6-95fc-790e356d020e]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:01 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Deleted volume successfully. Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-61cc1fb0-d478-4db7-b3f7-e9bc26bf8635 tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-292c2711-be58-48b2-b8df-4719441d3bf7-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:12:01 devstack sudo[112570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 Jun 27 20:12:01 devstack sudo[112570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:01 devstack sudo[112570]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651" returned: 0 in 0.769s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:01 devstack sudo[112575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651 Jun 27 20:12:01 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:02 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1be5b87e-b788-4e7f-97f7-98ba2d8bf651" returned: 0 in 0.648s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-quobyte-1be5b87e-b788-4e7f-97f7-98ba2d8bf651" released by "delete_volume" :: held 1.466s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Created reservations ['efc275aa-221a-43a5-b0f7-f0541397530f', 'fc17eb72-501c-4dc5-bd60-7f2d9f747b1a', '5c5a50d7-ee6e-40b2-a2e8-2c5858ca9bd3', '8907fa09-fa95-49af-9fb8-5ba026c058f6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:12:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:02 devstack sudo[112579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:12:02 devstack sudo[112579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:03 devstack sudo[112579]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:03 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:12:03 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Deleted volume successfully. Jun 27 20:12:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6fff6672-bda8-4f8d-8cad-47cc3770130e tempest-CinderUnicodeTest-1329772264 None] Lock "cinder-1be5b87e-b788-4e7f-97f7-98ba2d8bf651-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:12:12 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=7 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:12:13 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:12:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:16 devstack sudo[112629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:12:16 devstack sudo[112629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:17 devstack sudo[112629]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.835s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:12:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:12:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:12:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:12:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-12d37622-695a-40c8-aeff-af639051914d req-7f8a09d0-bd5c-4c3d-bc29-07a80c52f4ff tempest-TestShelveInstance-1276622139 None] Terminate volume connection completed successfully. Jun 27 20:12:19 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-12d37622-695a-40c8-aeff-af639051914d req-7f8a09d0-bd5c-4c3d-bc29-07a80c52f4ff tempest-TestShelveInstance-1276622139 None] Deleting attachment 1bb3c7c7-8f8c-451e-85b7-45f175824cc0. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:12:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Acquiring lock "cinder-71aa9322-6554-414b-941c-fd9234abef2c-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Lock "cinder-71aa9322-6554-414b-941c-fd9234abef2c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Acquiring lock "cinder-quobyte-71aa9322-6554-414b-941c-fd9234abef2c" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Lock "cinder-quobyte-71aa9322-6554-414b-941c-fd9234abef2c" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[001ceda0-1f96-4c3d-8d39-e266b38a14ed]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:20 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:12:20 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:20 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 0.767s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:20 devstack sudo[112680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:12:20 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:21 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 1 in 0.763s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:12:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:21 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c Jun 27 20:12:21 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:22 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-71aa9322-6554-414b-941c-fd9234abef2c" returned: 0 in 0.646s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Lock "cinder-quobyte-71aa9322-6554-414b-941c-fd9234abef2c" released by "delete_volume" :: held 2.239s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG cinder.quota [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Created reservations ['c4231f52-ad3f-4e27-8aef-7dd9d88e547d', '7e599fab-b9bb-4dc0-8523-887d84b93837', '3b02dc11-75eb-4f46-ba51-8904f384ef97', '569742f0-2d91-4c93-8e19-07440531d9af'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:12:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:22 devstack sudo[112688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:12:22 devstack sudo[112688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:23 devstack sudo[112688]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.686s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:23 devstack cinder-volume[93503]: DEBUG cinder.manager [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:12:23 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Deleted volume successfully. Jun 27 20:12:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [req-12d37622-695a-40c8-aeff-af639051914d req-6e69d9ee-4c27-48ad-a8fd-2f68b3722872 tempest-TestShelveInstance-1276622139 None] Lock "cinder-71aa9322-6554-414b-941c-fd9234abef2c-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:12:32 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:12:33 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Flow 'volume_create_manager' (50fb9d5d-95e6-43e7-b13f-d0a43e3e7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea6b038-6ce6-4011-ac3a-1e2b6200e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea6b038-6ce6-4011-ac3a-1e2b6200e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-558991992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875318fa-a964-4001-a6b9-322af4dd4c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd8a89a4cb84d1ab5ded052f892f2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:12:52Z,use_quota=True,user_id='09a8099b4a174c4e8c76325339229a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cba7cab-eb40-4fb7-b222-9ffb6bc824d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cba7cab-eb40-4fb7-b222-9ffb6bc824d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccea340-0524-4243-a62b-c6bafb58a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccea340-0524-4243-a62b-c6bafb58a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875318fa-a964-4001-a6b9-322af4dd4c3f', 'volume_name': 'volume-875318fa-a964-4001-a6b9-322af4dd4c3f', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07511785-aa89-4200-ab48-79f20b3215d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07511785-aa89-4200-ab48-79f20b3215d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32e4a0c-14cc-49b9-b17d-2c76c925026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:12:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Volume 875318fa-a964-4001-a6b9-322af4dd4c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875318fa-a964-4001-a6b9-322af4dd4c3f', 'volume_size': 1} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-558991992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875318fa-a964-4001-a6b9-322af4dd4c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd8a89a4cb84d1ab5ded052f892f2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:12:52Z,use_quota=True,user_id='09a8099b4a174c4e8c76325339229a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Creating volume 875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:12:51 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:12:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:51 devstack sudo[112735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f 1073741824 Jun 27 20:12:51 devstack sudo[112735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:52 devstack sudo[112735]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f 1073741824" returned: 0 in 0.883s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:12:52 devstack sudo[112744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:12:52 devstack sudo[112744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:12:53 devstack sudo[112744]: pam_unix(sudo:session): session closed for user root Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.665s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32e4a0c-14cc-49b9-b17d-2c76c925026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875318fa-a964-4001-a6b9-322af4dd4c3f', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed9242a-26a8-4d9e-93c9-8289912e9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:12:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Volume volume-875318fa-a964-4001-a6b9-322af4dd4c3f (875318fa-a964-4001-a6b9-322af4dd4c3f): created successfully Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed9242a-26a8-4d9e-93c9-8289912e9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:12:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Flow 'volume_create_manager' (50fb9d5d-95e6-43e7-b13f-d0a43e3e7a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:12:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-eb92fbdd-eda0-4ea7-b971-d0f708e75073 tempest-TestStampPattern-704090809 None] Created volume successfully. Jun 27 20:13:03 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:13:03 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:16 devstack sudo[112871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:13:16 devstack sudo[112871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:16 devstack sudo[112871]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.636s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:13:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:13:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:13:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:13:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707aa95-230a-4436-b94f-89255d32f0b4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:13:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:32 devstack sudo[112941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:13:32 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:33 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.730s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.749s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:13:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-875318fa-a964-4001-a6b9-322af4dd4c3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e95dea8-b9fa-498e-bac6-21f52e7aabfa', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:13:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-0f7d52a5-0851-431b-9c32-e6f98881dc77 req-952097e5-2749-4a48-8a14-dad5bbd655b7 tempest-TestStampPattern-704090809 None] attachment_update completed successfully. Jun 27 20:13:41 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-0e8bb5d9-eb05-4ecb-b045-cfd4317554bb req-0d656e7e-cb00-4f2a-b1af-919fc2403f19 tempest-TestStampPattern-704090809 None] Terminate volume connection completed successfully. Jun 27 20:13:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-0e8bb5d9-eb05-4ecb-b045-cfd4317554bb req-0d656e7e-cb00-4f2a-b1af-919fc2403f19 tempest-TestStampPattern-704090809 None] Deleting attachment 4e95dea8-b9fa-498e-bac6-21f52e7aabfa. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:13:43 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:13:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:13:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:13:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Creating offline snapshot 2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 of volume 875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:13:43 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b841f-098c-4803-ab2e-21fb0d458f75]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:13:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:43 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:13:43 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:44 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:44 devstack sudo[113390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 1G Jun 27 20:13:44 devstack sudo[113390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:44 devstack sudo[113390]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 1G" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875318fa-a964-4001-a6b9-322af4dd4c3f -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:44 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875318fa-a964-4001-a6b9-322af4dd4c3f -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 Jun 27 20:13:44 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:45 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875318fa-a964-4001-a6b9-322af4dd4c3f -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" returned: 0 in 0.677s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:45 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 is being set with open permissions: ugo+rw Jun 27 20:13:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:45 devstack sudo[113401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 Jun 27 20:13:45 devstack sudo[113401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:46 devstack sudo[113401]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" returned: 0 in 0.636s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:46 devstack sudo[113404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info Jun 27 20:13:46 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:46 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info" returned: 0 in 0.638s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:46 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info is being set with open permissions: ugo+rw Jun 27 20:13:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:46 devstack sudo[113407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info Jun 27 20:13:46 devstack sudo[113407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:47 devstack sudo[113407]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.info" returned: 0 in 0.627s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.168s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:13:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9cd880d9-d275-4d97-a89e-2f5097cdbfbe tempest-TestStampPattern-704090809 None] Create snapshot completed successfully Jun 27 20:13:57 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:13:57 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Flow 'volume_create_manager' (6611b7c5-59bb-4e22-bb53-894d7ef3baf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330beeb8-c103-46af-8b7d-5dbefccd2f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330beeb8-c103-46af-8b7d-5dbefccd2f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-216942552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db19107-4a45-46fd-b431-3390fceaa68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd8a89a4cb84d1ab5ded052f892f2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2869f5b6-320f-4a9b-8061-bfecd1c4d3d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:13:58Z,use_quota=True,user_id='09a8099b4a174c4e8c76325339229a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322ded0c-8af1-45fa-a3e6-e087c50ea9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322ded0c-8af1-45fa-a3e6-e087c50ea9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a203f2d-29af-4a83-b95f-d32dc06f6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a203f2d-29af-4a83-b95f-d32dc06f6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4db19107-4a45-46fd-b431-3390fceaa68a', 'volume_name': 'volume-4db19107-4a45-46fd-b431-3390fceaa68a', 'volume_size': 1, 'snapshot_id': '2869f5b6-320f-4a9b-8061-bfecd1c4d3d0'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a36e407-99e6-4331-9695-26d8f70551ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a36e407-99e6-4331-9695-26d8f70551ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a50110-8cde-46f7-853b-4b7ffc582197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:13:58 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Volume 4db19107-4a45-46fd-b431-3390fceaa68a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4db19107-4a45-46fd-b431-3390fceaa68a', 'volume_size': 1, 'snapshot_id': '2869f5b6-320f-4a9b-8061-bfecd1c4d3d0'} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-quobyte-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0-4db19107-4a45-46fd-b431-3390fceaa68a" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0-4db19107-4a45-46fd-b431-3390fceaa68a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Creating volume 4db19107-4a45-46fd-b431-3390fceaa68a from snapshot 2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-quobyte-4db19107-4a45-46fd-b431-3390fceaa68a" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-4db19107-4a45-46fd-b431-3390fceaa68a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] snapshot: 2869f5b6-320f-4a9b-8061-bfecd1c4d3d0, volume: 4db19107-4a45-46fd-b431-3390fceaa68a, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d57ad2-d558-4521-8eb5-fcd72299ec6b]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:13:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:58 devstack sudo[113449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 Jun 27 20:13:58 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:13:59 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root Jun 27 20:13:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" returned: 0 in 0.827s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:13:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875318fa-a964-4001-a6b9-322af4dd4c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:13:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:13:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:13:59 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c11250-5e50-4570-9e97-b5c6163382b9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:13:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:13:59 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:13:59 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:14:00 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Jun 27 20:14:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.797s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:14:00 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:14:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:14:00 devstack sudo[113462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a Jun 27 20:14:00 devstack sudo[113462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:14:05 devstack sudo[113462]: pam_unix(sudo:session): session closed for user root Jun 27 20:14:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a" returned: 0 in 5.078s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:14:05 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a71c1-8432-44b7-9b65-8cb52ac21f98]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:14:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:14:05 devstack sudo[113480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:14:05 devstack sudo[113480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:14:06 devstack sudo[113480]: pam_unix(sudo:session): session closed for user root Jun 27 20:14:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 1.106s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:14:06 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:14:06 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Converted 1024.00 MB image at 201.60 MB/s Jun 27 20:14:06 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a is being set with open permissions: ugo+rw Jun 27 20:14:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:14:06 devstack sudo[113487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a Jun 27 20:14:06 devstack sudo[113487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:14:07 devstack sudo[113487]: pam_unix(sudo:session): session closed for user root Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a" returned: 0 in 0.748s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-4db19107-4a45-46fd-b431-3390fceaa68a" released by "_copy_volume_from_snapshot" :: held 8.676s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0-4db19107-4a45-46fd-b431-3390fceaa68a" released by "_create_volume_from_snapshot" :: held 8.712s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.730s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a50110-8cde-46f7-853b-4b7ffc582197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db19107-4a45-46fd-b431-3390fceaa68a', 'volume_size': 1, 'snapshot_id': '2869f5b6-320f-4a9b-8061-bfecd1c4d3d0'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d41e46-2d0e-442d-aa6b-1e557cea56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:14:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Volume volume-4db19107-4a45-46fd-b431-3390fceaa68a (4db19107-4a45-46fd-b431-3390fceaa68a): created successfully Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d41e46-2d0e-442d-aa6b-1e557cea56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:14:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Flow 'volume_create_manager' (6611b7c5-59bb-4e22-bb53-894d7ef3baf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:14:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bfae6abd-b960-4c91-8a03-e00f861adbd1 tempest-TestStampPattern-704090809 None] Created volume successfully. Jun 27 20:14:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:14:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:14:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:14:17 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:14:17 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:DELETE=1 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:14:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:14:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:14:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0f98e-4757-498d-893d-1f5c8b0d0544]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:14:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:14:42 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a Jun 27 20:14:42 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:14:43 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Jun 27 20:14:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a" returned: 0 in 0.740s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:14:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.755s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:14:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19', 'name': 'volume-4db19107-4a45-46fd-b431-3390fceaa68a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e7afbc2-0738-4668-a3f1-f430dd0ab3a8', 'enforce_multipath': True} {{(pid=93503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 20:14:43 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-5a4edeb8-dd3d-490d-a7ee-0c8c7e5a6a2b req-00c15f2d-7b72-4f2e-8c8b-e65380592b5b tempest-TestStampPattern-704090809 None] attachment_update completed successfully. Jun 27 20:14:49 devstack cinder-volume[93503]: INFO cinder.volume.manager [req-bb25c964-bf47-4c88-8aa7-f52629ad281e req-875af946-942d-46f6-a35d-8ce63c570ee7 tempest-TestStampPattern-704090809 None] Terminate volume connection completed successfully. Jun 27 20:14:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [req-bb25c964-bf47-4c88-8aa7-f52629ad281e req-875af946-942d-46f6-a35d-8ce63c570ee7 tempest-TestStampPattern-704090809 None] Deleting attachment 5e7afbc2-0738-4668-a3f1-f430dd0ab3a8. {{(pid=93503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 20:14:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-4db19107-4a45-46fd-b431-3390fceaa68a-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:14:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Lock "cinder-4db19107-4a45-46fd-b431-3390fceaa68a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:14:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-quobyte-4db19107-4a45-46fd-b431-3390fceaa68a" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:14:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-4db19107-4a45-46fd-b431-3390fceaa68a" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:14:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[364c1933-7725-4748-aa8c-68f1f132c712]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:14:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:14:58 devstack sudo[114147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a Jun 27 20:14:58 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:14:59 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root Jun 27 20:14:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a" returned: 0 in 0.740s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:14:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:14:59 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a Jun 27 20:14:59 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:00 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4db19107-4a45-46fd-b431-3390fceaa68a" returned: 0 in 0.631s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-4db19107-4a45-46fd-b431-3390fceaa68a" released by "delete_volume" :: held 1.416s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Created reservations ['9d3c366f-1084-426a-80b9-5a4378b8e1e3', '0e74d86b-e565-4856-b3ff-1282c113ba21', 'c0a7736b-d658-4d80-8684-26b83283156a', '55a55e8b-87ab-4547-8800-ff3b4ede1e06'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:00 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:00 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:00 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.634s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Deleted volume successfully. Jun 27 20:15:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5aeb0643-eda9-40e2-9a90-0d3865a32977 tempest-TestStampPattern-704090809 None] Lock "cinder-4db19107-4a45-46fd-b431-3390fceaa68a-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Lock "cinder-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-quobyte-875318fa-a964-4001-a6b9-322af4dd4c3f" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-875318fa-a964-4001-a6b9-322af4dd4c3f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-quobyte-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Deleting offline snapshot 2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 of volume 875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] snapshot_file for this snap is: volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f458c-143b-4d8a-b193-85e61ac0d408]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:01 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 Jun 27 20:15:01 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:01 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" returned: 0 in 0.724s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875318fa-a964-4001-a6b9-322af4dd4c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5071926a-a5fb-44ce-bb5c-b15ea86bae73]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:02 devstack sudo[114166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:15:02 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:02 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.757s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:02 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 Jun 27 20:15:02 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:03 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" returned: 0 in 0.738s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:03 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0 Jun 27 20:15:03 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:04 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f.2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" returned: 0 in 0.646s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0" released by "_delete_snapshot" :: held 2.958s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-875318fa-a964-4001-a6b9-322af4dd4c3f" released by "delete_snapshot" :: held 2.979s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:04 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Created reservations ['8d99cc5e-6e44-47c7-9742-89ec7c701c64', '20d8a3fa-c972-451f-86da-26f8e1ba1a69', '8391f71e-c46f-4d44-a595-712f7462f7b1', 'f9c1a31c-8228-4972-90e5-e22f42b6bb41'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Delete snapshot completed successfully. Jun 27 20:15:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a6c04edd-a773-444d-89aa-da67a7ea03d2 tempest-TestStampPattern-704090809 None] Lock "cinder-2869f5b6-320f-4a9b-8061-bfecd1c4d3d0-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-875318fa-a964-4001-a6b9-322af4dd4c3f-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Lock "cinder-875318fa-a964-4001-a6b9-322af4dd4c3f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Acquiring lock "cinder-quobyte-875318fa-a964-4001-a6b9-322af4dd4c3f" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-875318fa-a964-4001-a6b9-322af4dd4c3f" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d0639-e096-4f50-8391-45a2977d5b92]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:11 devstack sudo[114239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:15:11 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:12 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.759s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:12 devstack sudo[114244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f Jun 27 20:15:12 devstack sudo[114244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:12 devstack sudo[114244]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-875318fa-a964-4001-a6b9-322af4dd4c3f" returned: 0 in 0.629s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:12 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Lock "cinder-quobyte-875318fa-a964-4001-a6b9-322af4dd4c3f" released by "delete_volume" :: held 1.442s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:12 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Created reservations ['4b8ac9e7-a7e7-460b-9d54-c311fef5678b', '79cfb10a-c72b-4e17-9954-ccbf2853fc73', '55b1990e-ef42-45eb-a7c7-081f4a9b9419', 'a3115b74-cf81-406b-96ab-53a9f4b0f30e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:13 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:13 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:13 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.638s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:13 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Deleted volume successfully. Jun 27 20:15:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-7178d155-6842-4791-bcc9-aa19f01f6456 tempest-TestStampPattern-704090809 None] Lock "cinder-875318fa-a964-4001-a6b9-322af4dd4c3f-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:16 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:16 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:16 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:15:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:15:23 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:15:23 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=21,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (d8c28c58-1537-480a-b334-c9923e50c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83057512-39e5-4f14-b79d-3c2b8d76bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83057512-39e5-4f14-b79d-3c2b8d76bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593504017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00786b4-31bd-4068-82b1-11fce8328040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:33Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f8d58b-94ee-4b89-a46e-ee527692f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f8d58b-94ee-4b89-a46e-ee527692f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecce5e99-8fcd-49ce-abaa-2ebaf6bfa700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecce5e99-8fcd-49ce-abaa-2ebaf6bfa700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00786b4-31bd-4068-82b1-11fce8328040', 'volume_name': 'volume-c00786b4-31bd-4068-82b1-11fce8328040', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecb3d11-51c3-41e1-9417-9b156ae535cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecb3d11-51c3-41e1-9417-9b156ae535cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee337b-5c7b-420f-a130-52753bffee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume c00786b4-31bd-4068-82b1-11fce8328040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00786b4-31bd-4068-82b1-11fce8328040', 'volume_size': 1} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593504017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00786b4-31bd-4068-82b1-11fce8328040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:33Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Creating volume c00786b4-31bd-4068-82b1-11fce8328040 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:33 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:33 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 1073741824 Jun 27 20:15:33 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (3851ad7c-11c5-4b50-9776-6eea11dcd616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c7f744-9bd9-48ad-afb2-f629550dce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c7f744-9bd9-48ad-afb2-f629550dce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871917565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db97a4b-7012-4081-ab13-04a98ea7ddfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:34Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15463338-7c4b-4d48-8f19-258c3b325640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15463338-7c4b-4d48-8f19-258c3b325640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9f6218-7598-4117-96a6-f186ed0f3ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9f6218-7598-4117-96a6-f186ed0f3ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db97a4b-7012-4081-ab13-04a98ea7ddfd', 'volume_name': 'volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b21f57-b794-4b8f-abaf-698a9c48ee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b21f57-b794-4b8f-abaf-698a9c48ee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7172c270-a993-42e9-bd3e-6b206d739fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:33 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Volume 3db97a4b-7012-4081-ab13-04a98ea7ddfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd', 'volume_size': 1} Jun 27 20:15:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (395c06dd-df3f-403b-94dc-35ef7f3c9894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e514b3-911c-42d9-a7be-f29fd7a37884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e514b3-911c-42d9-a7be-f29fd7a37884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319727980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea921b2-4a03-4da6-9baf-2ccada41c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:34Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d7a860-721b-4423-adca-836f98aa06fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d7a860-721b-4423-adca-836f98aa06fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd7d9c8-74f9-4b46-9bd1-a35542a7f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd7d9c8-74f9-4b46-9bd1-a35542a7f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea921b2-4a03-4da6-9baf-2ccada41c465', 'volume_name': 'volume-1ea921b2-4a03-4da6-9baf-2ccada41c465', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe27cea-e5ad-40ea-be13-1ff91fc0fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe27cea-e5ad-40ea-be13-1ff91fc0fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e08f0c-5873-41a1-bcb0-94d9cba28510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume 1ea921b2-4a03-4da6-9baf-2ccada41c465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea921b2-4a03-4da6-9baf-2ccada41c465', 'volume_size': 1} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (0630bc01-9f6f-488e-b6ed-63a6524d0fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e91ee1-7551-4ce6-8b1a-539d055a1ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e91ee1-7551-4ce6-8b1a-539d055a1ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173862292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf6389d-995b-4230-b077-e74723834eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:34Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a9bfe4-1715-45de-ad51-63aeb16b9101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a9bfe4-1715-45de-ad51-63aeb16b9101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2036779-d104-40f6-acf0-0c5d19a18918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2036779-d104-40f6-acf0-0c5d19a18918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf6389d-995b-4230-b077-e74723834eef', 'volume_name': 'volume-9cf6389d-995b-4230-b077-e74723834eef', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79de4213-6f35-40f8-9be3-b24fa7d60778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79de4213-6f35-40f8-9be3-b24fa7d60778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4fa2d3-59cd-4240-b53b-306b70b96ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Volume 9cf6389d-995b-4230-b077-e74723834eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf6389d-995b-4230-b077-e74723834eef', 'volume_size': 1} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:34 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 1073741824" returned: 0 in 1.069s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:34 devstack sudo[114344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 Jun 27 20:15:34 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (aa5318fd-a264-4603-97c8-fce09a1c1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c18047d-fbb0-4971-9b9d-af3b075cc4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c18047d-fbb0-4971-9b9d-af3b075cc4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886996472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a943fc9-7d4f-4a9c-b316-f945c97f49bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:35Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cc341e-024f-4bd7-a1fa-98d2a88524da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cc341e-024f-4bd7-a1fa-98d2a88524da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fb19da-f257-4df5-b61f-fbe0ae817754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fb19da-f257-4df5-b61f-fbe0ae817754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a943fc9-7d4f-4a9c-b316-f945c97f49bf', 'volume_name': 'volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfebd7fd-acbe-4e50-a15d-1ba2e17a2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfebd7fd-acbe-4e50-a15d-1ba2e17a2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc33aaa-5289-4222-a07d-c29629688859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:34 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Volume 8a943fc9-7d4f-4a9c-b316-f945c97f49bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf', 'volume_size': 1} Jun 27 20:15:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (48944adc-586f-4bc6-93c9-806da60e886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217ea861-d06b-4ab9-bff8-b54180bbfac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217ea861-d06b-4ab9-bff8-b54180bbfac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2020404743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f92df1b-4049-48ff-b848-e92c84624de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:35Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83579383-54f7-47d9-b5e3-5a663bb17178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83579383-54f7-47d9-b5e3-5a663bb17178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c8e727-2a7f-4c9a-821d-28eebd4edadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c8e727-2a7f-4c9a-821d-28eebd4edadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f92df1b-4049-48ff-b848-e92c84624de1', 'volume_name': 'volume-4f92df1b-4049-48ff-b848-e92c84624de1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff4c06-e73f-4623-906b-c4c1b24988eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff4c06-e73f-4623-906b-c4c1b24988eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194754fd-c035-4ad0-83ab-f7ff95cbb02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Volume 4f92df1b-4049-48ff-b848-e92c84624de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f92df1b-4049-48ff-b848-e92c84624de1', 'volume_size': 1} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:35 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040" returned: 0 in 0.751s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871917565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db97a4b-7012-4081-ab13-04a98ea7ddfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:34Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Creating volume 3db97a4b-7012-4081-ab13-04a98ea7ddfd {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:35 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee337b-5c7b-420f-a130-52753bffee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00786b4-31bd-4068-82b1-11fce8328040', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd 1073741824 Jun 27 20:15:35 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155772e3-3322-4025-9ca0-fc68e8bd80ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume volume-c00786b4-31bd-4068-82b1-11fce8328040 (c00786b4-31bd-4068-82b1-11fce8328040): created successfully Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155772e3-3322-4025-9ca0-fc68e8bd80ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (d8c28c58-1537-480a-b334-c9923e50c688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:35 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9aff39f7-84a4-434f-a85b-a03c9300a3ef tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created volume successfully. Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (6f066125-c1c4-4ba6-b726-d867a06281ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff85e4f-ee41-4cbb-9b51-3d253dd5489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff85e4f-ee41-4cbb-9b51-3d253dd5489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372204638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96be9d89-e04b-4c1c-bc1f-ede1ee57d897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:35Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899d047f-868a-4002-adab-8c0e8fcef5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899d047f-868a-4002-adab-8c0e8fcef5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48273aaa-e5c1-4570-b594-5f7dc9f66f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48273aaa-e5c1-4570-b594-5f7dc9f66f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96be9d89-e04b-4c1c-bc1f-ede1ee57d897', 'volume_name': 'volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ece9bc6-dc38-4e06-a1dc-0c0a2daa5837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ece9bc6-dc38-4e06-a1dc-0c0a2daa5837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2646d06-4b96-4ff0-b2db-723d45d1981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:35 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Volume 96be9d89-e04b-4c1c-bc1f-ede1ee57d897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897', 'volume_size': 1} Jun 27 20:15:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:36 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd 1073741824" returned: 0 in 0.928s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:36 devstack sudo[114353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd Jun 27 20:15:36 devstack sudo[114353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:36 devstack sudo[114353]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd" returned: 0 in 0.689s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.859s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319727980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea921b2-4a03-4da6-9baf-2ccada41c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:34Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating volume 1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:37 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7172c270-a993-42e9-bd3e-6b206d739fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e79fe1-bdcc-4e70-9f9b-a44ad929eac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack sudo[114356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 1073741824 Jun 27 20:15:37 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (6788740f-4718-411e-aee2-9a51ebbc48e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9c4c09-048a-47f1-b667-35a9bd885d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Volume volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd (3db97a4b-7012-4081-ab13-04a98ea7ddfd): created successfully Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e79fe1-bdcc-4e70-9f9b-a44ad929eac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (3851ad7c-11c5-4b50-9776-6eea11dcd616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9c4c09-048a-47f1-b667-35a9bd885d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655458438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f74bb70-3461-4341-bd02-9270806f75ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:37Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41aa5cc5-a8f8-44f5-b0c7-d962379b9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41aa5cc5-a8f8-44f5-b0c7-d962379b9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfd50de-d5bc-4db5-931c-e8328eae78a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfd50de-d5bc-4db5-931c-e8328eae78a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f74bb70-3461-4341-bd02-9270806f75ba', 'volume_name': 'volume-6f74bb70-3461-4341-bd02-9270806f75ba', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaa19de-c7c5-4da8-8d9d-7c07de878919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaa19de-c7c5-4da8-8d9d-7c07de878919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af209620-dcbe-4582-a4fd-bfc94baba837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume 6f74bb70-3461-4341-bd02-9270806f75ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f74bb70-3461-4341-bd02-9270806f75ba', 'volume_size': 1} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d303df0e-fa17-439f-8966-fc01e6f5dcae tempest-CreateVolumesFromImageTest-237318805 None] Created volume successfully. Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (9a35fd6f-aebf-4ce2-9b28-313c21f54bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4308719-5861-406a-ab65-07014bbc148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4308719-5861-406a-ab65-07014bbc148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681650039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd7b092-8b5d-4f1d-a961-1533b3f11d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:37Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ae1823-4781-4dc6-96fe-d017635ebba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ae1823-4781-4dc6-96fe-d017635ebba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86916431-d996-437b-b80a-6a386ae6d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86916431-d996-437b-b80a-6a386ae6d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd7b092-8b5d-4f1d-a961-1533b3f11d45', 'volume_name': 'volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff5f22-9339-4b1f-8587-346d6eb7e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff5f22-9339-4b1f-8587-346d6eb7e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0899add-15dd-4d53-99bf-2bc062cb4e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:37 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume afd7b092-8b5d-4f1d-a961-1533b3f11d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45', 'volume_size': 1} Jun 27 20:15:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:38 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 1073741824" returned: 0 in 1.027s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:38 devstack sudo[114362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 Jun 27 20:15:38 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Flow 'volume_create_manager' (34d2428d-a081-4686-9ade-819452e24f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb44e7f2-fed0-43a9-951c-856308b0c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb44e7f2-fed0-43a9-951c-856308b0c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216eb32e-166b-40a4-b7ce-a58e2b4092da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca728fcd96749c18a91b856ff0788b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:38Z,use_quota=True,user_id='d1b7fdf03a7543e2bffd7e1c1e39f90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24f3e82-2033-48f6-bf22-69c890264a67),volume_type_id=b24f3e82-2033-48f6-bf22-69c890264a67)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6274aa40-88e1-41ae-afe8-83f07bbdb284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6274aa40-88e1-41ae-afe8-83f07bbdb284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d5026d-86bd-4ad6-b89c-043be3538dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (0e9ff43f-4548-44a0-8686-5322b1a61df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50268d49-5b80-49b1-9497-c15ce1144459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50268d49-5b80-49b1-9497-c15ce1144459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393983635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72552d60-0876-4aa3-a3fa-75384e47f1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:38Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4502e9d7-94bf-4ead-8cb4-74e025d1ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4502e9d7-94bf-4ead-8cb4-74e025d1ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b4f107-9361-4925-bf0a-e672687fd642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b4f107-9361-4925-bf0a-e672687fd642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72552d60-0876-4aa3-a3fa-75384e47f1ba', 'volume_name': 'volume-72552d60-0876-4aa3-a3fa-75384e47f1ba', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd5de49-3149-4fe8-b76d-177c84394dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd5de49-3149-4fe8-b76d-177c84394dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2d44ea-eae5-40e7-859b-614b43620230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume 72552d60-0876-4aa3-a3fa-75384e47f1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72552d60-0876-4aa3-a3fa-75384e47f1ba', 'volume_size': 1} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (ab480d81-c0f6-480c-beb5-ae41d66f940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0e7548-29ea-47e6-aa66-6d2dcd1f2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0e7548-29ea-47e6-aa66-6d2dcd1f2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676829374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf736c3e-ede6-4025-a79c-129c7a8a73ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:38Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebd4baa-26f6-45d8-993f-59c4e1dfb0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebd4baa-26f6-45d8-993f-59c4e1dfb0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e973e9aa-14e8-4ca0-921c-8a553442a5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e973e9aa-14e8-4ca0-921c-8a553442a5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf736c3e-ede6-4025-a79c-129c7a8a73ee', 'volume_name': 'volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ebc6c-e665-40ef-b536-7d5e325eb8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ebc6c-e665-40ef-b536-7d5e325eb8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01126ce5-257d-4544-aac2-f504d3c69f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume bf736c3e-ede6-4025-a79c-129c7a8a73ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee', 'volume_size': 1} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (ed514976-fc90-4955-8c84-5b06e1c59421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b12aff0-24cd-442b-9d76-36302774d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b12aff0-24cd-442b-9d76-36302774d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1680316870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284b10ad-000f-434e-b293-3ec4e0246abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:39Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7ea851-8699-4138-94df-8b07ac8cab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7ea851-8699-4138-94df-8b07ac8cab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b6f1aa-fa62-41c5-b0fd-e444866f5b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b6f1aa-fa62-41c5-b0fd-e444866f5b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284b10ad-000f-434e-b293-3ec4e0246abe', 'volume_name': 'volume-284b10ad-000f-434e-b293-3ec4e0246abe', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f9c431-036b-4c93-a0dd-713b02eb1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f9c431-036b-4c93-a0dd-713b02eb1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96b5bb1-5f05-4b0c-9e50-4f8ce3ed156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume 284b10ad-000f-434e-b293-3ec4e0246abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284b10ad-000f-434e-b293-3ec4e0246abe', 'volume_size': 1} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d5026d-86bd-4ad6-b89c-043be3538dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '216eb32e-166b-40a4-b7ce-a58e2b4092da', 'volume_name': 'volume-216eb32e-166b-40a4-b7ce-a58e2b4092da', 'volume_size': 1, 'image_id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7825ebb7-2ca2-495f-9571-0eca36146f57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a8a7823ae39cba543b1a58953d16e0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ca728fcd96749c18a91b856ff0788b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db57f7a27a4f6e318b1e933a13cb87fcbe130ef1b45d2135d290d7504ed3b3ab1bdb64e0b0a3373c03b6d38d1746f4de5e8d0fcee5c8386ce3ba5bd2e3a627b8', 'id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'created_at': datetime.datetime(2026, 6, 27, 18, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7825ebb7-2ca2-495f-9571-0eca36146f57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45acf128-e63c-4d4c-a450-0028d2a37a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45acf128-e63c-4d4c-a450-0028d2a37a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f734ac-29e0-439f-809a-00c44e19bd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:38 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Volume 216eb32e-166b-40a4-b7ce-a58e2b4092da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-216eb32e-166b-40a4-b7ce-a58e2b4092da', 'volume_size': 1, 'image_id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7825ebb7-2ca2-495f-9571-0eca36146f57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a8a7823ae39cba543b1a58953d16e0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ca728fcd96749c18a91b856ff0788b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db57f7a27a4f6e318b1e933a13cb87fcbe130ef1b45d2135d290d7504ed3b3ab1bdb64e0b0a3373c03b6d38d1746f4de5e8d0fcee5c8386ce3ba5bd2e3a627b8', 'id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'created_at': datetime.datetime(2026, 6, 27, 18, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7825ebb7-2ca2-495f-9571-0eca36146f57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Trying to clone 216eb32e-166b-40a4-b7ce-a58e2b4092da from image 7825ebb7-2ca2-495f-9571-0eca36146f57 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7825ebb7-2ca2-495f-9571-0eca36146f57', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:15:38 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465" returned: 0 in 0.850s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.456s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173862292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf6389d-995b-4230-b077-e74723834eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:34Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Creating volume 9cf6389d-995b-4230-b077-e74723834eef {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:38 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:15:38 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Image download 0.00 MB at 0.00 MB/s Jun 27 20:15:38 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef 1073741824 Jun 27 20:15:38 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e08f0c-5873-41a1-bcb0-94d9cba28510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea921b2-4a03-4da6-9baf-2ccada41c465', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:38 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68503049-17e4-4323-9844-3d51d98cd10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:39 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 (1ea921b2-4a03-4da6-9baf-2ccada41c465): created successfully Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68503049-17e4-4323-9844-3d51d98cd10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (395c06dd-df3f-403b-94dc-35ef7f3c9894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de550c87-fd04-45b3-a469-677b7bb780ae]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8363d39f-2a5f-4877-929f-512695857f5e tempest-CreateVolumesFromSnapshotTest-316147212 None] Created volume successfully. Jun 27 20:15:39 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD Jun 27 20:15:39 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:39 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:39 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef 1073741824" returned: 0 in 0.940s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:39 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef Jun 27 20:15:39 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:39 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD Jun 27 20:15:39 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:40 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:40 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef" returned: 0 in 0.647s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.867s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886996472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a943fc9-7d4f-4a9c-b316-f945c97f49bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:35Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Creating volume 8a943fc9-7d4f-4a9c-b316-f945c97f49bf {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:40 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Temporary image 7825ebb7-2ca2-495f-9571-0eca36146f57 is fetched for user d1b7fdf03a7543e2bffd7e1c1e39f90f. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:15:40 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf 1073741824 Jun 27 20:15:40 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4fa2d3-59cd-4240-b53b-306b70b96ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf6389d-995b-4230-b077-e74723834eef', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5295ac-6a6f-4581-9ffc-705203f14109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:40 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Volume volume-9cf6389d-995b-4230-b077-e74723834eef (9cf6389d-995b-4230-b077-e74723834eef): created successfully Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5295ac-6a6f-4581-9ffc-705203f14109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (0630bc01-9f6f-488e-b6ed-63a6524d0fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:40 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b77b123c-f837-4375-a9a8-c187c7893e92 tempest-CreateVolumesFromImageTest-237318805 None] Created volume successfully. Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a419a0e2-e710-43a1-bfc8-2f3352ef1727]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:40 devstack sudo[114385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD Jun 27 20:15:40 devstack sudo[114385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:41 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf 1073741824" returned: 0 in 0.844s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:41 devstack sudo[114385]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:41 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf Jun 27 20:15:41 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:41 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD Jun 27 20:15:41 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:42 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf" returned: 0 in 0.663s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.024s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2020404743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f92df1b-4049-48ff-b848-e92c84624de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:35Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Creating volume 4f92df1b-4049-48ff-b848-e92c84624de1 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:42 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc33aaa-5289-4222-a07d-c29629688859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:42 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 1073741824 Jun 27 20:15:42 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f8dcf2-ac5e-4e4a-bdd2-a81478a8a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:42 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Volume volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf (8a943fc9-7d4f-4a9c-b316-f945c97f49bf): created successfully Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f8dcf2-ac5e-4e4a-bdd2-a81478a8a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:42 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (aa5318fd-a264-4603-97c8-fce09a1c1773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d16c24bc-31e7-49fb-91e0-0b8bd7225fa3 tempest-CreateVolumesFromImageTest-237318805 None] Created volume successfully. Jun 27 20:15:42 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 1073741824" returned: 0 in 0.826s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:43 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 Jun 27 20:15:43 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:43 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1" returned: 0 in 0.653s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.139s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372204638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96be9d89-e04b-4c1c-bc1f-ede1ee57d897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7254709f2ab4e4aa7bfdb76b5be6228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:35Z,use_quota=True,user_id='2149cc42ccd0411486be23c9df28df19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Creating volume 96be9d89-e04b-4c1c-bc1f-ede1ee57d897 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:43 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:43 devstack sudo[114409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 1073741824 Jun 27 20:15:43 devstack sudo[114409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194754fd-c035-4ad0-83ab-f7ff95cbb02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f92df1b-4049-48ff-b848-e92c84624de1', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deab13aa-cce3-4da4-819a-89017ea9eaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:43 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Volume volume-4f92df1b-4049-48ff-b848-e92c84624de1 (4f92df1b-4049-48ff-b848-e92c84624de1): created successfully Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deab13aa-cce3-4da4-819a-89017ea9eaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:43 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (48944adc-586f-4bc6-93c9-806da60e886e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:43 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f3334ea2-131f-4c5d-b0fa-0f6cb850d039 tempest-CreateVolumesFromImageTest-237318805 None] Created volume successfully. Jun 27 20:15:44 devstack sudo[114409]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 1073741824" returned: 0 in 0.806s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:44 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 Jun 27 20:15:44 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:45 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897" returned: 0 in 0.654s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.004s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655458438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f74bb70-3461-4341-bd02-9270806f75ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:37Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Creating volume 6f74bb70-3461-4341-bd02-9270806f75ba {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:45 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:45 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba 1073741824 Jun 27 20:15:45 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2646d06-4b96-4ff0-b2db-723d45d1981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a9289c-8bde-4612-a8aa-dd8ddea42587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:45 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Volume volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 (96be9d89-e04b-4c1c-bc1f-ede1ee57d897): created successfully Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a9289c-8bde-4612-a8aa-dd8ddea42587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Flow 'volume_create_manager' (6f066125-c1c4-4ba6-b726-d867a06281ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:45 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a831b9fc-eefd-4259-bd92-24449c36aa60 tempest-CreateVolumesFromImageTest-237318805 None] Created volume successfully. Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-96be9d89-e04b-4c1c-bc1f-ede1ee57d897-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-96be9d89-e04b-4c1c-bc1f-ede1ee57d897-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-quobyte-96be9d89-e04b-4c1c-bc1f-ede1ee57d897" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-96be9d89-e04b-4c1c-bc1f-ede1ee57d897" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6517009-2c06-411e-b597-d726da8aa525]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:45 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 Jun 27 20:15:45 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:46 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba 1073741824" returned: 0 in 0.849s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:46 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba Jun 27 20:15:46 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:46 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897" returned: 0 in 0.789s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:46 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897 Jun 27 20:15:46 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:46 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba" returned: 0 in 0.660s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.274s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681650039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd7b092-8b5d-4f1d-a961-1533b3f11d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:37Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Creating volume afd7b092-8b5d-4f1d-a961-1533b3f11d45 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:46 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af209620-dcbe-4582-a4fd-bfc94baba837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f74bb70-3461-4341-bd02-9270806f75ba', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:46 devstack sudo[114435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 1073741824 Jun 27 20:15:46 devstack sudo[114435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a45be89-6b16-4af3-9e53-e2e18c4efdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:46 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume volume-6f74bb70-3461-4341-bd02-9270806f75ba (6f74bb70-3461-4341-bd02-9270806f75ba): created successfully Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a45be89-6b16-4af3-9e53-e2e18c4efdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:46 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (6788740f-4718-411e-aee2-9a51ebbc48e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:46 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-f1d0a183-8180-4a95-b568-aa0fa9690536 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created volume successfully. Jun 27 20:15:47 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-96be9d89-e04b-4c1c-bc1f-ede1ee57d897" returned: 0 in 0.654s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-96be9d89-e04b-4c1c-bc1f-ede1ee57d897" released by "delete_volume" :: held 1.484s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Created reservations ['4588db7d-fed6-435e-9964-166054d2a328', 'cbba08d4-8671-42c7-b6a8-367e84c50648', 'd663d659-1276-4fe3-832b-7e345154450c', 'e4ac564e-2179-46a2-8216-099e16d26d9e'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:47 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:47 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:47 devstack sudo[114435]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 1073741824" returned: 0 in 0.839s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-4f92df1b-4049-48ff-b848-e92c84624de1-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:47 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 Jun 27 20:15:47 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-4f92df1b-4049-48ff-b848-e92c84624de1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-quobyte-4f92df1b-4049-48ff-b848-e92c84624de1" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-4f92df1b-4049-48ff-b848-e92c84624de1" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[15244ca7-4864-4672-88aa-43711925e3b3]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:47 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.693s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Deleted volume successfully. Jun 27 20:15:47 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6475f4d5-161b-4b0e-b065-318d56d878c1 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-96be9d89-e04b-4c1c-bc1f-ede1ee57d897-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:47 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 Jun 27 20:15:47 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:48 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45" returned: 0 in 0.675s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.950s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393983635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72552d60-0876-4aa3-a3fa-75384e47f1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:38Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Creating volume 72552d60-0876-4aa3-a3fa-75384e47f1ba {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:48 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0899add-15dd-4d53-99bf-2bc062cb4e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8823811-6f00-44b2-bcd2-7fbdd718432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:48 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba 1073741824 Jun 27 20:15:48 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:48 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 (afd7b092-8b5d-4f1d-a961-1533b3f11d45): created successfully Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8823811-6f00-44b2-bcd2-7fbdd718432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (9a35fd6f-aebf-4ce2-9b28-313c21f54bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:48 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d140ccb4-43f9-4c3d-91b3-dddd50b6622e tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created volume successfully. Jun 27 20:15:48 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1" returned: 0 in 0.786s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:48 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1 Jun 27 20:15:48 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:49 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba 1073741824" returned: 0 in 0.863s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:49 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4f92df1b-4049-48ff-b848-e92c84624de1" returned: 0 in 0.678s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:49 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba Jun 27 20:15:49 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-4f92df1b-4049-48ff-b848-e92c84624de1" released by "delete_volume" :: held 1.513s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Created reservations ['92a63a24-b465-421c-9e96-db52d9de8a26', '5dc1d5b1-c05e-4d52-b7a9-749ed708f76d', '826e5052-380c-4278-82d1-c6033718df51', '81288f72-5404-41d1-9858-6b2bce2a57d4'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:49 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:49 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:49 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba" returned: 0 in 0.644s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.357s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676829374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf736c3e-ede6-4025-a79c-129c7a8a73ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:38Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Creating volume bf736c3e-ede6-4025-a79c-129c7a8a73ee {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:49 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-8a943fc9-7d4f-4a9c-b316-f945c97f49bf-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:49 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee 1073741824 Jun 27 20:15:49 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:49 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2d44ea-eae5-40e7-859b-614b43620230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72552d60-0876-4aa3-a3fa-75384e47f1ba', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53731a1-eff6-4871-b470-3986808f30ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-8a943fc9-7d4f-4a9c-b316-f945c97f49bf-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:50 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume volume-72552d60-0876-4aa3-a3fa-75384e47f1ba (72552d60-0876-4aa3-a3fa-75384e47f1ba): created successfully Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53731a1-eff6-4871-b470-3986808f30ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (0e9ff43f-4548-44a0-8686-5322b1a61df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-quobyte-8a943fc9-7d4f-4a9c-b316-f945c97f49bf" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-54cc9c0a-9df0-4113-a118-6a1eda998925 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created volume successfully. Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-8a943fc9-7d4f-4a9c-b316-f945c97f49bf" acquired by "delete_volume" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b7ad50-a4d1-4683-830c-e6afd1569485]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:50 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.770s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:50 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Deleted volume successfully. Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b91641da-9759-4f69-827c-270d00386fa7 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-4f92df1b-4049-48ff-b848-e92c84624de1-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:50 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf Jun 27 20:15:50 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:50 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee 1073741824" returned: 0 in 0.865s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:50 devstack sudo[114475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee Jun 27 20:15:50 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:50 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf" returned: 0 in 0.824s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:51 devstack sudo[114478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf Jun 27 20:15:51 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:51 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.674s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1680316870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284b10ad-000f-434e-b293-3ec4e0246abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4d77874ea94665a2fec1172b71dec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:39Z,use_quota=True,user_id='016d58db05384862938c4f20d79a67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Creating volume 284b10ad-000f-434e-b293-3ec4e0246abe {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:51 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:51 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe 1073741824 Jun 27 20:15:51 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01126ce5-257d-4544-aac2-f504d3c69f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f2bc45-e345-452d-a355-6ad6313938ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:51 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee (bf736c3e-ede6-4025-a79c-129c7a8a73ee): created successfully Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f2bc45-e345-452d-a355-6ad6313938ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (ab480d81-c0f6-480c-beb5-ae41d66f940c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:51 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-cafe5ee9-9eb9-4454-90d6-a50166038a3c tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created volume successfully. Jun 27 20:15:51 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-8a943fc9-7d4f-4a9c-b316-f945c97f49bf" returned: 0 in 0.638s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-8a943fc9-7d4f-4a9c-b316-f945c97f49bf" released by "delete_volume" :: held 1.523s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Created reservations ['979212a2-1adb-40f2-95fb-119b82edc92e', '92168529-ebf7-458d-8ee2-653bf39b396f', 'cde641c7-5086-4c2a-bfd0-b797cddd0cac', '92581926-02ae-4188-be10-3605118d80da'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:51 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:51 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-9cf6389d-995b-4230-b077-e74723834eef-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-9cf6389d-995b-4230-b077-e74723834eef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-quobyte-9cf6389d-995b-4230-b077-e74723834eef" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-9cf6389d-995b-4230-b077-e74723834eef" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db5959-c897-4c1c-a565-e92b379e4090]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:52 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.681s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:52 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Deleted volume successfully. Jun 27 20:15:52 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef Jun 27 20:15:52 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-16786da5-9370-4d32-b107-93c6bf352161 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-8a943fc9-7d4f-4a9c-b316-f945c97f49bf-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:52 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe 1073741824" returned: 0 in 1.007s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:52 devstack sudo[114493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe Jun 27 20:15:52 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:53 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef" returned: 0 in 0.777s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:53 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef Jun 27 20:15:53 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:53 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe" returned: 0 in 0.684s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.469s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating offline snapshot 1c277e1b-aa1c-4dc5-8e86-71d849239d04 of volume 1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96b5bb1-5f05-4b0c-9e50-4f8ce3ed156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284b10ad-000f-434e-b293-3ec4e0246abe', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120362c7-6a3d-47b0-81f5-eac27f67f0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228b73e-eb9e-4b3f-a821-7d44c9795b29]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:53 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Volume volume-284b10ad-000f-434e-b293-3ec4e0246abe (284b10ad-000f-434e-b293-3ec4e0246abe): created successfully Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120362c7-6a3d-47b0-81f5-eac27f67f0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Flow 'volume_create_manager' (ed514976-fc90-4955-8c84-5b06e1c59421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:53 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fb22406c-8b47-42bf-a369-a635fe312726 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created volume successfully. Jun 27 20:15:53 devstack sudo[114501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 Jun 27 20:15:53 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:53 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-9cf6389d-995b-4230-b077-e74723834eef" returned: 0 in 0.658s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-9cf6389d-995b-4230-b077-e74723834eef" released by "delete_volume" :: held 1.482s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Created reservations ['8a0ae41e-6e0b-4848-890d-0d40487ec75c', '7390a544-4f10-4004-9f1f-6e22dadd5681', '95867e49-dd09-4143-af40-0462fa8f4102', '4c097312-9afa-43e8-9b9a-9b6d6b660f52'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-284b10ad-000f-434e-b293-3ec4e0246abe-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-284b10ad-000f-434e-b293-3ec4e0246abe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-quobyte-284b10ad-000f-434e-b293-3ec4e0246abe" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:53 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-284b10ad-000f-434e-b293-3ec4e0246abe" acquired by "delete_volume" :: waited 0.037s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:53 devstack sudo[114507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:53 devstack sudo[114507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc57218-4e4b-4612-a829-42282b7208f1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:54 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465" returned: 0 in 0.800s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:54 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 1G Jun 27 20:15:54 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:54 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe Jun 27 20:15:54 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-3db97a4b-7012-4081-ab13-04a98ea7ddfd-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-3db97a4b-7012-4081-ab13-04a98ea7ddfd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "cinder-quobyte-3db97a4b-7012-4081-ab13-04a98ea7ddfd" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-3db97a4b-7012-4081-ab13-04a98ea7ddfd" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d6c73-ec94-4b6e-b7c3-e62c5153ea62]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:54 devstack sudo[114507]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.743s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:54 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Deleted volume successfully. Jun 27 20:15:54 devstack sudo[114516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd Jun 27 20:15:54 devstack sudo[114516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-5cfe625a-47a8-4955-a7c9-498d970943b9 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-9cf6389d-995b-4230-b077-e74723834eef-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:54 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe" returned: 0 in 0.896s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:54 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe Jun 27 20:15:54 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:55 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 1G" returned: 0 in 0.984s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:55 devstack sudo[114527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 Jun 27 20:15:55 devstack sudo[114527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:55 devstack sudo[114516]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd" returned: 0 in 0.835s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:55 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd Jun 27 20:15:55 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:55 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-284b10ad-000f-434e-b293-3ec4e0246abe" returned: 0 in 0.657s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-284b10ad-000f-434e-b293-3ec4e0246abe" released by "delete_volume" :: held 1.610s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created reservations ['759a1c4f-9027-4d68-a85e-f832c761edb3', 'dc6def22-3377-4d82-acf6-b9e3efcce002', '030d4ae9-5eca-402b-88ac-73e07aa3b542', 'e6ccfa79-55f6-476f-92af-344fafea09ec'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:55 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:55 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:55 devstack sudo[114527]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04" returned: 0 in 0.741s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:55 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 is being set with open permissions: ugo+rw Jun 27 20:15:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:55 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 Jun 27 20:15:55 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-bf736c3e-ede6-4025-a79c-129c7a8a73ee-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:56 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-bf736c3e-ede6-4025-a79c-129c7a8a73ee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-3db97a4b-7012-4081-ab13-04a98ea7ddfd" returned: 0 in 0.735s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-quobyte-3db97a4b-7012-4081-ab13-04a98ea7ddfd" released by "delete_volume" :: held 1.638s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-quobyte-bf736c3e-ede6-4025-a79c-129c7a8a73ee" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-bf736c3e-ede6-4025-a79c-129c7a8a73ee" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbf6e74-a91c-4e5c-99e5-07aabf598a40]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Created reservations ['331ac368-9de9-4b38-9e38-dc94932fa665', '8452917f-df29-4b50-b2e3-9925efec8be6', '28964d50-27a9-4ffb-9e4a-5a4b24394d7b', '78622e64-c485-4083-bf54-22da74735c96'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:56 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.709s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:56 devstack sudo[114544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee Jun 27 20:15:56 devstack sudo[114544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Deleted volume successfully. Jun 27 20:15:56 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:56 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-6781bc8f-02f9-4730-8aed-82ccd6c44825 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-284b10ad-000f-434e-b293-3ec4e0246abe-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:56 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04" returned: 0 in 0.786s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:56 devstack sudo[114549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info Jun 27 20:15:56 devstack sudo[114549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:57 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.756s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:57 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Deleted volume successfully. Jun 27 20:15:57 devstack sudo[114544]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee" returned: 0 in 0.916s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:57 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee Jun 27 20:15:57 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9cb81bca-d27f-4637-b72a-7cbf9943d524 tempest-CreateVolumesFromImageTest-237318805 None] Lock "cinder-3db97a4b-7012-4081-ab13-04a98ea7ddfd-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:57 devstack sudo[114549]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info" returned: 0 in 0.728s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:57 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info is being set with open permissions: ugo+rw Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:57 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info Jun 27 20:15:57 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:57 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-bf736c3e-ede6-4025-a79c-129c7a8a73ee" returned: 0 in 0.731s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-bf736c3e-ede6-4025-a79c-129c7a8a73ee" released by "delete_volume" :: held 1.697s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created reservations ['b7005375-2cd1-4885-b7f3-4ab53485e051', '1c1523fd-0e46-4cc5-8f66-61edba7649c4', '44d7cdb4-5926-46ff-acf1-74b0a2fe0192', '7d196acc-2bf1-41b2-b2e6-641fd7115c12'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:15:58 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.info" returned: 0 in 0.715s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.860s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.898s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216eb32e-166b-40a4-b7ce-a58e2b4092da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca728fcd96749c18a91b856ff0788b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:38Z,use_quota=True,user_id='d1b7fdf03a7543e2bffd7e1c1e39f90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24f3e82-2033-48f6-bf22-69c890264a67),volume_type_id=b24f3e82-2033-48f6-bf22-69c890264a67)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Creating volume 216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:15:58 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:58 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da 1073741824 Jun 27 20:15:58 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:58 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2f3d37d7-7e17-417f-ad2e-c986e75d0b45 tempest-CreateVolumesFromSnapshotTest-316147212 None] Create snapshot completed successfully Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:58 devstack sudo[114564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:15:58 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-72552d60-0876-4aa3-a3fa-75384e47f1ba-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-72552d60-0876-4aa3-a3fa-75384e47f1ba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-quobyte-72552d60-0876-4aa3-a3fa-75384e47f1ba" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-72552d60-0876-4aa3-a3fa-75384e47f1ba" acquired by "delete_volume" :: waited 0.036s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c153d60-2753-442f-bf0f-fa0dca0fe01c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:15:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:58 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba Jun 27 20:15:58 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:58 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:15:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Deleted volume successfully. Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-2bc4996c-4ba0-45ca-8d7c-7a25ce5b2a6b tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-bf736c3e-ede6-4025-a79c-129c7a8a73ee-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (44944ed4-a9c8-4dfc-a289-a850e6c947e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f828fc79-5ab4-4345-9296-f0921e248f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f828fc79-5ab4-4345-9296-f0921e248f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469504857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63263dc-7e6f-43f5-b69b-c4a9b2d67f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:59Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0bbec7-6f10-4382-a6f9-2cb9d3589468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0bbec7-6f10-4382-a6f9-2cb9d3589468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca03bb1-3529-4001-9cdf-36c0d616230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca03bb1-3529-4001-9cdf-36c0d616230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63263dc-7e6f-43f5-b69b-c4a9b2d67f21', 'volume_name': 'volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e1f3b9-cb14-45e9-b67b-0f935568a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e1f3b9-cb14-45e9-b67b-0f935568a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98cce2a-5fe7-4c0f-81c6-209f343534e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume e63263dc-7e6f-43f5-b69b-c4a9b2d67f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21', 'volume_size': 1} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da 1073741824" returned: 0 in 1.313s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:59 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:15:59 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:59 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba" returned: 0 in 1.088s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:15:59 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba Jun 27 20:15:59 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (be02ea5f-f6b6-4292-bb8e-84ffd07854f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d36df2-faa9-4f45-9ec7-05c73f736684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d36df2-faa9-4f45-9ec7-05c73f736684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908637293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c6fab4-1757-42dd-8fd4-b6a907540f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:00Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e7fee-0e92-4507-8220-1241d5a9e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e7fee-0e92-4507-8220-1241d5a9e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0237be-5e3e-46c5-a614-1d27a86f7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0237be-5e3e-46c5-a614-1d27a86f7322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c6fab4-1757-42dd-8fd4-b6a907540f45', 'volume_name': 'volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ec19e9-dc2d-48d6-a3fc-7ce5452f1816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ec19e9-dc2d-48d6-a3fc-7ce5452f1816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643ebca7-4d70-4812-a0c6-b1f396980775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:15:59 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume c9c6fab4-1757-42dd-8fd4-b6a907540f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45', 'volume_size': 1} Jun 27 20:15:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (a0b1c2a1-4a74-4db5-8353-b23669c14fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26484295-44db-4dce-b65f-faf437adb1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26484295-44db-4dce-b65f-faf437adb1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1761654148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce66582-725b-4ccd-8e89-9c24b3002dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:00Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6215d-2036-4acf-8e77-137e32fe4b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6215d-2036-4acf-8e77-137e32fe4b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2e7e5b-bf87-4cb7-a7d3-dd15450d88bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2e7e5b-bf87-4cb7-a7d3-dd15450d88bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce66582-725b-4ccd-8e89-9c24b3002dd8', 'volume_name': 'volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b46996-23a4-4449-9a19-4ffd6d233803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b46996-23a4-4449-9a19-4ffd6d233803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8e1121-fcba-453b-9950-388d08e81766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:00 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume 0ce66582-725b-4ccd-8e89-9c24b3002dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8', 'volume_size': 1} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:00 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 0 in 1.066s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469504857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63263dc-7e6f-43f5-b69b-c4a9b2d67f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:15:59Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating volume e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:00 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:00 devstack sudo[114581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 1073741824 Jun 27 20:16:00 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Attempting download of 7825ebb7-2ca2-495f-9571-0eca36146f57 ((None, [{'url': 'file:///opt/stack/data/glance/images/7825ebb7-2ca2-495f-9571-0eca36146f57', 'metadata': {}}])) to volume 216eb32e-166b-40a4-b7ce-a58e2b4092da. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d206b33-439c-4535-ac02-591b3a9448c3]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:00 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-72552d60-0876-4aa3-a3fa-75384e47f1ba" returned: 0 in 1.117s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-72552d60-0876-4aa3-a3fa-75384e47f1ba" released by "delete_volume" :: held 2.266s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:00 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt Jun 27 20:16:00 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created reservations ['d19530b0-feff-40fd-8b45-dad629487076', '5de17bcf-6cd7-425a-88a5-c794b5f39ede', '1ada119e-ada8-4e01-8944-653d756f92da', '5bc831b0-8c8b-4b56-abfc-4b6f10bb9fbe'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (3f83572a-106b-486e-96b8-bc2fb34e4c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cff7ce0-a9b2-4204-9fdd-52c886528ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Flow 'volume_create_manager' (fc568c46-77de-40c4-b90e-c12d4c946dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703c5941-181e-4ed8-b90b-ad846f1deb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703c5941-181e-4ed8-b90b-ad846f1deb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-748427049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1bdeea-afc2-40be-b227-76bb7a3c8187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c70a2caca834770acf7a85003567f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:01Z,use_quota=True,user_id='9c0edf3d5e0c4d33aa58c586e655a8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6606eee7-9314-494c-894f-2184c7d7e1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6606eee7-9314-494c-894f-2184c7d7e1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af596827-c1e8-4fd8-b7fd-759505cc8402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af596827-c1e8-4fd8-b7fd-759505cc8402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1bdeea-afc2-40be-b227-76bb7a3c8187', 'volume_name': 'volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5f863c-312d-47a0-bfd8-f8500d553916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5f863c-312d-47a0-bfd8-f8500d553916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba1fdb3-a684-4e56-a90d-a3cafaecb678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Volume dd1bdeea-afc2-40be-b227-76bb7a3c8187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187', 'volume_size': 1} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cff7ce0-a9b2-4204-9fdd-52c886528ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435127989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53a00d7-c70a-4367-a6ef-ef32f69f1bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:01Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce7bc5a-4c23-43c0-820e-547866b0fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce7bc5a-4c23-43c0-820e-547866b0fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7170d8-225b-4a49-8283-b5ef6de7921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7170d8-225b-4a49-8283-b5ef6de7921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53a00d7-c70a-4367-a6ef-ef32f69f1bd2', 'volume_name': 'volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3441103f-3d39-4dd5-98d7-113b75b9d9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3441103f-3d39-4dd5-98d7-113b75b9d9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75565c2b-e8fc-4780-9e03-1b406776774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume b53a00d7-c70a-4367-a6ef-ef32f69f1bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2', 'volume_size': 1} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:01 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:01 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (a094e67c-4db3-43af-8c9a-a8c2f4a67387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df9c15-ae1c-4ee2-bfc3-fc051453be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df9c15-ae1c-4ee2-bfc3-fc051453be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390718586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:01Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23395722-c152-408b-8ea9-fa9ae6b1dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23395722-c152-408b-8ea9-fa9ae6b1dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa13c79-23b8-4f47-9afc-6f7fe37365d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa13c79-23b8-4f47-9afc-6f7fe37365d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b', 'volume_name': 'volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77733367-4d34-4b0a-8a98-813e1fd9fabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77733367-4d34-4b0a-8a98-813e1fd9fabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35687cc-64da-4b4e-8c41-ec790f2048c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:01 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume 5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b', 'volume_size': 1} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:01 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 1073741824" returned: 0 in 0.993s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:01 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 Jun 27 20:16:01 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:01 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt" returned: 0 in 1.043s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-afd7b092-8b5d-4f1d-a961-1533b3f11d45-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-afd7b092-8b5d-4f1d-a961-1533b3f11d45-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:01 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt Jun 27 20:16:01 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-quobyte-afd7b092-8b5d-4f1d-a961-1533b3f11d45" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-afd7b092-8b5d-4f1d-a961-1533b3f11d45" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50cf285-c834-4ff9-9018-803ad08fb388]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:02 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.783s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Deleted volume successfully. Jun 27 20:16:02 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 Jun 27 20:16:02 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9c6de185-9130-400f-a046-4edd1e060619 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-72552d60-0876-4aa3-a3fa-75384e47f1ba-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:02 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21" returned: 0 in 0.707s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908637293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c6fab4-1757-42dd-8fd4-b6a907540f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:00Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating volume c9c6fab4-1757-42dd-8fd4-b6a907540f45 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:02 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98cce2a-5fe7-4c0f-81c6-209f343534e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:02 devstack sudo[114603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 1073741824 Jun 27 20:16:02 devstack sudo[114603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3e2e8a-213a-4316-8b81-66a583d97da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:02 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 (e63263dc-7e6f-43f5-b69b-c4a9b2d67f21): created successfully Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3e2e8a-213a-4316-8b81-66a583d97da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (44944ed4-a9c8-4dfc-a289-a850e6c947e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:02 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8f783a04-b089-427e-9ec5-0f194fdfb4c6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created volume successfully. Jun 27 20:16:02 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt" returned: 1 in 0.893s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7825ebb7-2ca2-495f-9571-0eca36146f57_k4euwirt' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[013137d6-d36a-4442-ac36-edf77101fc98]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:02 devstack sudo[114607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD Jun 27 20:16:02 devstack sudo[114607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:02 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45" returned: 0 in 0.853s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:02 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45 Jun 27 20:16:02 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:03 devstack sudo[114603]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 1073741824" returned: 0 in 0.928s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:03 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 Jun 27 20:16:03 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:03 devstack sudo[114607]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:03 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-afd7b092-8b5d-4f1d-a961-1533b3f11d45" returned: 0 in 0.679s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-afd7b092-8b5d-4f1d-a961-1533b3f11d45" released by "delete_volume" :: held 1.586s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:03 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD Jun 27 20:16:03 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created reservations ['edb92fdc-3911-4e99-ac19-f7e1cbf13b1f', '354fc162-94a9-4015-a5ee-4927abf33dc2', 'cc493422-4748-43fa-9e8a-abf26facfdf7', '89ba1b00-f330-46b1-8e49-7e40a4b58b5d'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:03 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:03 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:03 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45" returned: 0 in 0.708s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.479s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1761654148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce66582-725b-4ccd-8e89-9c24b3002dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:00Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating volume 0ce66582-725b-4ccd-8e89-9c24b3002dd8 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:04 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643ebca7-4d70-4812-a0c6-b1f396980775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:04 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 1073741824 Jun 27 20:16:04 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420a93ee-e636-4a5e-9abb-428ae9d7694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:04 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 (c9c6fab4-1757-42dd-8fd4-b6a907540f45): created successfully Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420a93ee-e636-4a5e-9abb-428ae9d7694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (be02ea5f-f6b6-4292-bb8e-84ffd07854f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5e63f694-bcf5-4e8e-90a4-5a0b60e311e2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created volume successfully. Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-6f74bb70-3461-4341-bd02-9270806f75ba-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-6f74bb70-3461-4341-bd02-9270806f75ba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-quobyte-6f74bb70-3461-4341-bd02-9270806f75ba" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-6f74bb70-3461-4341-bd02-9270806f75ba" acquired by "delete_volume" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[26befa7f-e8df-4f8d-95ca-5c349b20f4b9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:04 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD" returned: 1 in 0.873s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] 7825ebb7-2ca2-495f-9571-0eca36146f57 was raw, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:04 devstack sudo[114635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:16:04 devstack sudo[114635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:04 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba Jun 27 20:16:04 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:04 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.829s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Deleted volume successfully. Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-71c58d19-9ad2-4c08-9356-4fcd2d12ab34 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-afd7b092-8b5d-4f1d-a961-1533b3f11d45-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:04 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 1073741824" returned: 0 in 0.933s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:05 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 Jun 27 20:16:05 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:05 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba" returned: 0 in 0.872s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:05 devstack sudo[114635]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 0 in 0.871s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7825ebb7-2ca2-495f-9571-0eca36146f57_17cl9o7pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:16:05 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 20:16:05 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba Jun 27 20:16:05 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:05 devstack sudo[114655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da 1G Jun 27 20:16:05 devstack sudo[114655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:05 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8" returned: 0 in 0.668s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.467s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-748427049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1bdeea-afc2-40be-b227-76bb7a3c8187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c70a2caca834770acf7a85003567f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:01Z,use_quota=True,user_id='9c0edf3d5e0c4d33aa58c586e655a8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Creating volume dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:05 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:05 devstack sudo[114658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 1073741824 Jun 27 20:16:05 devstack sudo[114658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8e1121-fcba-453b-9950-388d08e81766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f8a2a8-3f7e-4697-b44b-36031ec9dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 (0ce66582-725b-4ccd-8e89-9c24b3002dd8): created successfully Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f8a2a8-3f7e-4697-b44b-36031ec9dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (a0b1c2a1-4a74-4db5-8353-b23669c14fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-7dba600e-6688-44a7-80e2-577284239dd6 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created volume successfully. Jun 27 20:16:05 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-6f74bb70-3461-4341-bd02-9270806f75ba" returned: 0 in 0.741s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-6f74bb70-3461-4341-bd02-9270806f75ba" released by "delete_volume" :: held 1.658s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created reservations ['19d0e89c-85ee-4490-bd9d-993339e44227', 'a39d7363-053e-4f45-8647-7a7f0a2569ad', 'ce9b77b4-c147-45c9-9733-561b3698c143', '1f2b3710-ec5d-4eed-8ce8-37911be5e52f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:05 devstack sudo[114655]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da 1G" returned: 0 in 0.779s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed922d4-90f4-46c3-be99-0de16183a655]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:06 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:06 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:06 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:16:06 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-c00786b4-31bd-4068-82b1-11fce8328040-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-c00786b4-31bd-4068-82b1-11fce8328040-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "cinder-quobyte-c00786b4-31bd-4068-82b1-11fce8328040" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-c00786b4-31bd-4068-82b1-11fce8328040" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32657dd-14a8-452a-8da1-001ed0e50f1d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:06 devstack sudo[114658]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 1073741824" returned: 0 in 1.010s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:06 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 Jun 27 20:16:06 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:06 devstack sudo[114677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:06 devstack sudo[114677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:06 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.821s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Deleted volume successfully. Jun 27 20:16:06 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 0 in 0.899s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-72d53617-8c9c-4f4b-93d2-8a101673ca80 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-6f74bb70-3461-4341-bd02-9270806f75ba-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:07 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:16:07 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:07 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040" returned: 0 in 0.855s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:07 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040 Jun 27 20:16:07 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:07 devstack sudo[114677]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 0.719s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.228s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435127989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53a00d7-c70a-4367-a6ef-ef32f69f1bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:01Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating volume b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:07 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba1fdb3-a684-4e56-a90d-a3cafaecb678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:07 devstack sudo[114687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 1073741824 Jun 27 20:16:07 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4f63ba-c8d3-4406-a921-278aa6936ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Volume volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 (dd1bdeea-afc2-40be-b227-76bb7a3c8187): created successfully Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4f63ba-c8d3-4406-a921-278aa6936ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Flow 'volume_create_manager' (fc568c46-77de-40c4-b90e-c12d4c946dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-00499128-dcb3-4644-9125-664bb44f3e51 tempest-VolumeDependencyTests-1039115333 None] Created volume successfully. Jun 27 20:16:07 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 1 in 0.812s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Downloaded image 7825ebb7-2ca2-495f-9571-0eca36146f57 ((None, [{'url': 'file:///opt/stack/data/glance/images/7825ebb7-2ca2-495f-9571-0eca36146f57', 'metadata': {}}])) to volume 216eb32e-166b-40a4-b7ce-a58e2b4092da successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Temporary image 7825ebb7-2ca2-495f-9571-0eca36146f57 for user d1b7fdf03a7543e2bffd7e1c1e39f90f is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Marking volume 216eb32e-166b-40a4-b7ce-a58e2b4092da as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Copying metadata from image 7825ebb7-2ca2-495f-9571-0eca36146f57 to 216eb32e-166b-40a4-b7ce-a58e2b4092da. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Creating volume glance metadata for volume 216eb32e-166b-40a4-b7ce-a58e2b4092da backed by image 7825ebb7-2ca2-495f-9571-0eca36146f57 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a8a7823ae39cba543b1a58953d16e0e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f734ac-29e0-439f-809a-00c44e19bd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216eb32e-166b-40a4-b7ce-a58e2b4092da', 'volume_size': 1, 'image_id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7825ebb7-2ca2-495f-9571-0eca36146f57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a8a7823ae39cba543b1a58953d16e0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ca728fcd96749c18a91b856ff0788b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db57f7a27a4f6e318b1e933a13cb87fcbe130ef1b45d2135d290d7504ed3b3ab1bdb64e0b0a3373c03b6d38d1746f4de5e8d0fcee5c8386ce3ba5bd2e3a627b8', 'id': '7825ebb7-2ca2-495f-9571-0eca36146f57', 'created_at': datetime.datetime(2026, 6, 27, 18, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7825ebb7-2ca2-495f-9571-0eca36146f57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b188ab-6125-4878-bcac-92c8a9c983db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Volume volume-216eb32e-166b-40a4-b7ce-a58e2b4092da (216eb32e-166b-40a4-b7ce-a58e2b4092da): created successfully Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b188ab-6125-4878-bcac-92c8a9c983db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Flow 'volume_create_manager' (34d2428d-a081-4686-9ade-819452e24f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-df27958b-aea2-44ab-b3b2-5d12385322e7 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Created volume successfully. Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Acquiring lock "cinder-216eb32e-166b-40a4-b7ce-a58e2b4092da-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "cinder-216eb32e-166b-40a4-b7ce-a58e2b4092da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Acquiring lock "cinder-quobyte-216eb32e-166b-40a4-b7ce-a58e2b4092da" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "cinder-quobyte-216eb32e-166b-40a4-b7ce-a58e2b4092da" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:08 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c00786b4-31bd-4068-82b1-11fce8328040" returned: 0 in 0.777s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865b8d6-1c94-406d-b3a6-d7b58dc1e028]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-quobyte-c00786b4-31bd-4068-82b1-11fce8328040" released by "delete_volume" :: held 1.709s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Created reservations ['2534f7fc-4f57-4302-bae2-e40da9de7499', '21f58636-3cbc-4dd9-9dcb-8b6aa9f35ad0', '778ff005-d936-4162-8e49-695b573318dc', '69e9a837-0352-4392-87a6-3685c5fa8d93'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:08 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:16:08 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:08 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:08 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:08 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 1073741824" returned: 0 in 1.015s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:08 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 Jun 27 20:16:08 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:09 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 0 in 0.908s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:09 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.722s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Deleted volume successfully. Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-97728d16-4514-4cb8-b3f0-d52ec26b5ec7 tempest-CreateVolumesFromSourceVolumeTest-1721187412 None] Lock "cinder-c00786b4-31bd-4068-82b1-11fce8328040-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:09 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:16:09 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:09 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2" returned: 0 in 0.755s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.839s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390718586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab13f02e27c9468f93462b91e83f1b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:01Z,use_quota=True,user_id='d8722e92b5cf4f9fbf68ae9fa974cd3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Creating volume 5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:09 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75565c2b-e8fc-4780-9e03-1b406776774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637af64-5aa4-4297-a0b0-86fdfc42ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:09 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b 1073741824 Jun 27 20:16:09 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:09 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 (b53a00d7-c70a-4367-a6ef-ef32f69f1bd2): created successfully Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637af64-5aa4-4297-a0b0-86fdfc42ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:09 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (3f83572a-106b-486e-96b8-bc2fb34e4c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:09 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-0dc8b8de-a02a-4069-b499-a62b04648d3d tempest-CreateVolumesFromSnapshotTest-316147212 None] Created volume successfully. Jun 27 20:16:10 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 1 in 0.912s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:10 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da Jun 27 20:16:10 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:10 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b 1073741824" returned: 0 in 1.008s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:10 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b Jun 27 20:16:10 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:10 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-216eb32e-166b-40a4-b7ce-a58e2b4092da" returned: 0 in 0.752s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "cinder-quobyte-216eb32e-166b-40a4-b7ce-a58e2b4092da" released by "delete_volume" :: held 2.669s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Created reservations ['470879b0-55eb-451e-b278-d88c0667e19e', '2ad047c7-e630-4b26-982e-e7d95eec1f1d', '54f9747b-f263-4aa8-bab9-e18bb9302959', '30e37d2a-3676-4c17-8a7b-6d7388cc2835'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:11 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:11 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:11 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b" returned: 0 in 0.712s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.717s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Creating offline snapshot dfc36726-0cd0-40c0-b226-1301b491ff9c of volume dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35687cc-64da-4b4e-8c41-ec790f2048c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286ccf37-e414-4284-ace8-d281be279ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef8368-8c68-4650-becf-46f999bc8b42]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:11 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Volume volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b (5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b): created successfully Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286ccf37-e414-4284-ace8-d281be279ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Flow 'volume_create_manager' (a094e67c-4db3-43af-8c9a-a8c2f4a67387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-5b52a233-7323-4b70-afff-8472a7e72359 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created volume successfully. Jun 27 20:16:11 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:11 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17dd605-d839-471d-bd66-ad53117e9fda]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:11 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b Jun 27 20:16:11 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:11 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.955s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:11 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Deleted volume successfully. Jun 27 20:16:11 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-d6679ca1-6927-4906-8c94-b9d391da6689 tempest-VolumeAndVolumeTypeFromImageTest-167512610 None] Lock "cinder-216eb32e-166b-40a4-b7ce-a58e2b4092da-delete_volume" released by "delete_volume" :: held 3.900s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:12 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 1.043s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:12 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c 1G Jun 27 20:16:12 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:12 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b" returned: 0 in 1.020s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:12 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b Jun 27 20:16:12 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:13 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c 1G" returned: 0 in 1.150s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:13 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c Jun 27 20:16:13 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:13 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b" returned: 0 in 0.895s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b" released by "delete_volume" :: held 1.987s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['86ebe13a-91ac-47ca-bfa4-8e2cc5f8b68f', 'aaebeaa4-69be-482d-a7b4-a7b51948b86f', '8595b9fc-64fe-49a6-8d97-a4d787f646e6', '5f700f88-496e-4533-a059-7b4d6aa65a88'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:13 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:13 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2" acquired by "delete_volume" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[590fdd91-9178-466f-8064-47501a91452a]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:14 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 Jun 27 20:16:14 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c" returned: 0 in 1.157s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:14 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c is being set with open permissions: ugo+rw Jun 27 20:16:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:14 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:14 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.887s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:14 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:14 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleted volume successfully. Jun 27 20:16:14 devstack sudo[114764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c Jun 27 20:16:14 devstack sudo[114764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:14 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-4c216f4c-6b37-4fdb-90a2-d8205c68e304 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-5d7a529e-0e32-43f1-bbbb-e8c9bf5b699b-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:15 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2" returned: 0 in 1.291s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:15 devstack sudo[114771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2 Jun 27 20:16:15 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:15 devstack sudo[114764]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c" returned: 0 in 0.879s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:15 devstack sudo[114773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info Jun 27 20:16:15 devstack sudo[114773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:16 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2" returned: 0 in 0.752s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2" released by "delete_volume" :: held 2.111s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:16 devstack sudo[114773]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info" returned: 0 in 0.758s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:16 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info is being set with open permissions: ugo+rw Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['13a68b7f-cc54-42e9-aad1-bdd1e63c9b0a', 'a32dee39-0783-4bf1-8232-61ef27d4ec6a', '30948116-b677-4515-8947-fcc6cb01f854', 'b1c82150-5813-474c-a85a-a06b5c1e09df'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:16 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info Jun 27 20:16:16 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:16 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:16 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:16 devstack sudo[114781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:16 devstack sudo[114781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:16 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.info" returned: 0 in 0.778s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.901s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fe1addf0-9427-432a-a479-89207505e838 tempest-VolumeDependencyTests-1039115333 None] Create snapshot completed successfully Jun 27 20:16:17 devstack sudo[114781]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.698s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:17 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleted volume successfully. Jun 27 20:16:17 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.798s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dd4f1d55-3d7e-452d-9af6-69339aaff030 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-b53a00d7-c70a-4367-a6ef-ef32f69f1bd2-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-0ce66582-725b-4ccd-8e89-9c24b3002dd8-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-0ce66582-725b-4ccd-8e89-9c24b3002dd8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-0ce66582-725b-4ccd-8e89-9c24b3002dd8" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-0ce66582-725b-4ccd-8e89-9c24b3002dd8" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcfbb01-e931-4231-8a52-30c5d0b4fc33]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:17 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 Jun 27 20:16:17 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:18 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8" returned: 0 in 0.950s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:18 devstack sudo[114793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8 Jun 27 20:16:18 devstack sudo[114793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Flow 'volume_create_manager' (662ac493-2098-4297-909d-d2d847c67ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e11b5d5-926c-45d3-a988-5f5091dac18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e11b5d5-926c-45d3-a988-5f5091dac18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-19138913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dcbb31-5177-487a-bec0-b53ab90994cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c70a2caca834770acf7a85003567f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dfc36726-0cd0-40c0-b226-1301b491ff9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:19Z,use_quota=True,user_id='9c0edf3d5e0c4d33aa58c586e655a8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82564286-2ac5-4c40-a776-72e132e285dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82564286-2ac5-4c40-a776-72e132e285dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6209a824-3806-440a-b7b6-50698abdd924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6209a824-3806-440a-b7b6-50698abdd924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62dcbb31-5177-487a-bec0-b53ab90994cb', 'volume_name': 'volume-62dcbb31-5177-487a-bec0-b53ab90994cb', 'volume_size': 1, 'snapshot_id': 'dfc36726-0cd0-40c0-b226-1301b491ff9c'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752e82be-78af-41e2-b344-7da95d0babc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752e82be-78af-41e2-b344-7da95d0babc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7bc250-0f4d-42cc-bdbf-67544bdcd169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:18 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Volume 62dcbb31-5177-487a-bec0-b53ab90994cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62dcbb31-5177-487a-bec0-b53ab90994cb', 'volume_size': 1, 'snapshot_id': 'dfc36726-0cd0-40c0-b226-1301b491ff9c'} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-quobyte-dfc36726-0cd0-40c0-b226-1301b491ff9c-62dcbb31-5177-487a-bec0-b53ab90994cb" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dfc36726-0cd0-40c0-b226-1301b491ff9c-62dcbb31-5177-487a-bec0-b53ab90994cb" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Creating volume 62dcbb31-5177-487a-bec0-b53ab90994cb from snapshot dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-quobyte-62dcbb31-5177-487a-bec0-b53ab90994cb" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-62dcbb31-5177-487a-bec0-b53ab90994cb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] snapshot: dfc36726-0cd0-40c0-b226-1301b491ff9c, volume: 62dcbb31-5177-487a-bec0-b53ab90994cb, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5087d7-d0c4-4ec0-82ce-45d30b8033a1]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:18 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c Jun 27 20:16:18 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:19 devstack sudo[114793]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-0ce66582-725b-4ccd-8e89-9c24b3002dd8" returned: 0 in 0.771s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-0ce66582-725b-4ccd-8e89-9c24b3002dd8" released by "delete_volume" :: held 1.787s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['55962ebc-054c-4e13-9dc1-333d38bc6ec0', '041f7b54-ac8e-428b-bf5a-e6b351603f7f', 'e3107fa8-260c-47fe-b7a4-6265ebf218dc', '5616e3ab-fe7e-474a-8e4e-8acaf8f47460'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:19 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:19 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-c9c6fab4-1757-42dd-8fd4-b6a907540f45-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-c9c6fab4-1757-42dd-8fd4-b6a907540f45-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:19 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c" returned: 0 in 0.914s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-c9c6fab4-1757-42dd-8fd4-b6a907540f45" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[109035a4-78a5-4a5f-9f8b-ba8183270815]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-c9c6fab4-1757-42dd-8fd4-b6a907540f45" acquired by "delete_volume" :: waited 0.038s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d83e05-2ed3-4dc8-9294-dfaed30dfcd4]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:19 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:19 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:20 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 Jun 27 20:16:20 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:20 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 1.038s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:20 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleted volume successfully. Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-241f5eb3-7e5a-458d-a575-dd9e0ec6d4c2 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-0ce66582-725b-4ccd-8e89-9c24b3002dd8-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:20 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 0.968s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:20 devstack sudo[114813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb Jun 27 20:16:20 devstack sudo[114813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:20 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45" returned: 0 in 1.079s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:20 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45 Jun 27 20:16:21 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:21 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-c9c6fab4-1757-42dd-8fd4-b6a907540f45" returned: 0 in 0.754s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-c9c6fab4-1757-42dd-8fd4-b6a907540f45" released by "delete_volume" :: held 1.922s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:21 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['992d3aab-7ef2-43a8-b521-e8de5cfc53d3', 'fc12ae18-2b75-42d1-847b-4b4b62a9280e', '1b98c63a-7fd1-4ed3-939a-4eb0c8dce196', '2b00fc26-bba1-468b-b23b-2782c33d9d34'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:22 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:22 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:22 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:23 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:23 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c91546-a965-4074-aa41-4f2f90f646ee]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:23 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:24 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 Jun 27 20:16:24 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:24 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:24 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 2.153s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:24 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:24 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleted volume successfully. Jun 27 20:16:24 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-82c02463-ea19-4c6f-b677-490ee3da4a69 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-c9c6fab4-1757-42dd-8fd4-b6a907540f45-delete_volume" released by "delete_volume" :: held 4.829s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:25 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21" returned: 0 in 2.042s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:25 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:25 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21 Jun 27 20:16:25 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:27 devstack sudo[114813]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb" returned: 0 in 6.271s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fef955-2488-4221-99e7-82b2f1660893]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:27 devstack sudo[114842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:27 devstack sudo[114842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:27 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21" returned: 0 in 1.436s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21" released by "delete_volume" :: held 3.600s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=140,cinder:UPDATE=187,cinder:DELETE=16,cinder:INSERT=40 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['4b1529ec-d431-4a0b-973f-916a01f285ee', '5ce2e509-947e-451e-a029-cc9c8ffea8de', 'd3f36ac9-acb4-425d-87f1-e411111c44bd', 'c9dbeef2-a72f-4799-98c8-ae3a68fe50b3'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:27 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:27 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:27 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:28 devstack sudo[114842]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 1.043s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:16:28 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Converted 1024.00 MB image at 163.26 MB/s Jun 27 20:16:28 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb is being set with open permissions: ugo+rw Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:28 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb Jun 27 20:16:28 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-1c277e1b-aa1c-4dc5-8e86-71d849239d04-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:28 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.794s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleted volume successfully. Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-1c277e1b-aa1c-4dc5-8e86-71d849239d04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-1ea921b2-4a03-4da6-9baf-2ccada41c465" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-a3a5ac60-b962-4fd5-9079-73e6ee548aa9 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-e63263dc-7e6f-43f5-b69b-c4a9b2d67f21-delete_volume" released by "delete_volume" :: held 4.820s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-1ea921b2-4a03-4da6-9baf-2ccada41c465" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-1c277e1b-aa1c-4dc5-8e86-71d849239d04" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-1c277e1b-aa1c-4dc5-8e86-71d849239d04" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleting offline snapshot 1c277e1b-aa1c-4dc5-8e86-71d849239d04 of volume 1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] snapshot_file for this snap is: volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4ed156-ef6b-4d38-9e9e-78240247dda8]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:28 devstack sudo[114853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 Jun 27 20:16:28 devstack sudo[114853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:28 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb" returned: 0 in 0.736s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-62dcbb31-5177-487a-bec0-b53ab90994cb" released by "_copy_volume_from_snapshot" :: held 10.081s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dfc36726-0cd0-40c0-b226-1301b491ff9c-62dcbb31-5177-487a-bec0-b53ab90994cb" released by "_create_volume_from_snapshot" :: held 10.113s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.136s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7bc250-0f4d-42cc-bdbf-67544bdcd169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62dcbb31-5177-487a-bec0-b53ab90994cb', 'volume_size': 1, 'snapshot_id': 'dfc36726-0cd0-40c0-b226-1301b491ff9c'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd2bec5-7bb0-4ff8-b142-4e48fe420328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:28 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Volume volume-62dcbb31-5177-487a-bec0-b53ab90994cb (62dcbb31-5177-487a-bec0-b53ab90994cb): created successfully Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd2bec5-7bb0-4ff8-b142-4e48fe420328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:28 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Flow 'volume_create_manager' (662ac493-2098-4297-909d-d2d847c67ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:28 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-bfa08a33-c2fc-4f8b-a489-a5ad48123719 tempest-VolumeDependencyTests-1039115333 None] Created volume successfully. Jun 27 20:16:29 devstack sudo[114853]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04" returned: 0 in 0.862s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea921b2-4a03-4da6-9baf-2ccada41c465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c826ae-f8de-480a-b954-29758074864d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:29 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 Jun 27 20:16:29 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-dfc36726-0cd0-40c0-b226-1301b491ff9c-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-dfc36726-0cd0-40c0-b226-1301b491ff9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-quobyte-dd1bdeea-afc2-40be-b227-76bb7a3c8187" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dd1bdeea-afc2-40be-b227-76bb7a3c8187" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-quobyte-dfc36726-0cd0-40c0-b226-1301b491ff9c" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dfc36726-0cd0-40c0-b226-1301b491ff9c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Deleting offline snapshot dfc36726-0cd0-40c0-b226-1301b491ff9c of volume dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] snapshot_file for this snap is: volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbedfc2-a36b-4631-852c-8ce6ab9a0eac]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:29 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:30 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:30 devstack sudo[114865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c Jun 27 20:16:30 devstack sudo[114865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:30 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 Jun 27 20:16:30 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:30 devstack sudo[114865]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c" returned: 0 in 0.875s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b98cd6-bfd5-4ee9-a07d-5ecd3e5199f7]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:30 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04" returned: 0 in 0.876s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:30 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:30 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:30 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:30 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04 Jun 27 20:16:30 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:31 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465.1c277e1b-aa1c-4dc5-8e86-71d849239d04" returned: 0 in 0.688s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-1c277e1b-aa1c-4dc5-8e86-71d849239d04" released by "_delete_snapshot" :: held 3.396s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-1ea921b2-4a03-4da6-9baf-2ccada41c465" released by "delete_snapshot" :: held 3.425s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:31 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 0.856s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:31 devstack sudo[114885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c Jun 27 20:16:31 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['224ec23a-dc1f-4f83-962f-3456aeb61da1', 'bcc9977b-c494-4e46-8b24-93281899ada5', 'a6280dd5-0f1d-4c22-982a-9c14f4729970', '688c7298-2cbb-41a9-8287-6924b6dc773c'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:31 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Delete snapshot completed successfully. Jun 27 20:16:31 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1271bc46-5ce6-435a-8019-13f862a485c4 tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-1c277e1b-aa1c-4dc5-8e86-71d849239d04-delete_snapshot" released by "delete_snapshot" :: held 3.633s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-1ea921b2-4a03-4da6-9baf-2ccada41c465-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-1ea921b2-4a03-4da6-9baf-2ccada41c465-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "cinder-quobyte-1ea921b2-4a03-4da6-9baf-2ccada41c465" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-1ea921b2-4a03-4da6-9baf-2ccada41c465" acquired by "delete_volume" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb56a1-14a7-42fc-9ddf-46ec2965e315]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:32 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c" returned: 0 in 0.984s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:32 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:32 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c Jun 27 20:16:32 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:32 devstack sudo[114890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 Jun 27 20:16:32 devstack sudo[114890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:33 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187.dfc36726-0cd0-40c0-b226-1301b491ff9c" returned: 0 in 0.844s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:UPDATE=210,cinder:SELECT=144,cinder:INSERT=59,cinder:DELETE=21 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:16:33 devstack sudo[114890]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465" returned: 0 in 0.946s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dfc36726-0cd0-40c0-b226-1301b491ff9c" released by "_delete_snapshot" :: held 3.707s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:33 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465 Jun 27 20:16:33 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dd1bdeea-afc2-40be-b227-76bb7a3c8187" released by "delete_snapshot" :: held 3.741s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Created reservations ['1197a2ad-257d-4590-94c5-f9218e2e9131', '20f851ff-3c44-4af5-8bc6-dd6be23e3bd3', '0eb1df8e-5f09-4cc9-9c99-1ed4d047622e', '8c7fe963-1a9d-4d95-9e6c-d7b2a0b8eb30'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:33 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Delete snapshot completed successfully. Jun 27 20:16:33 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-3a8a0a81-8331-46eb-8996-f46716c867c5 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-dfc36726-0cd0-40c0-b226-1301b491ff9c-delete_snapshot" released by "delete_snapshot" :: held 3.913s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-dd1bdeea-afc2-40be-b227-76bb7a3c8187-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-dd1bdeea-afc2-40be-b227-76bb7a3c8187-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-quobyte-dd1bdeea-afc2-40be-b227-76bb7a3c8187" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dd1bdeea-afc2-40be-b227-76bb7a3c8187" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f5f6d4-43df-4713-bd67-f2183c589f58]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:34 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-1ea921b2-4a03-4da6-9baf-2ccada41c465" returned: 0 in 0.730s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-quobyte-1ea921b2-4a03-4da6-9baf-2ccada41c465" released by "delete_volume" :: held 1.740s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Created reservations ['1054a396-c6d3-4b9d-be98-841f0a6bc5ed', '29da4716-af13-4d99-9683-4fe76995c0ed', 'f9b1f460-d4d7-495b-a539-15d1f4ada681', 'f1df34db-bd1d-474f-b3fe-0d8596cdfd2f'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:34 devstack sudo[114937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:34 devstack sudo[114937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:34 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:34 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:34 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:35 devstack sudo[114937]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 0.917s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:35 devstack sudo[114946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187 Jun 27 20:16:35 devstack sudo[114946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:35 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:35 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.930s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:35 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:35 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Deleted volume successfully. Jun 27 20:16:35 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-c07aefee-b6c7-47ad-86e8-1fb53ae756ed tempest-CreateVolumesFromSnapshotTest-316147212 None] Lock "cinder-1ea921b2-4a03-4da6-9baf-2ccada41c465-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:36 devstack sudo[114946]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-dd1bdeea-afc2-40be-b227-76bb7a3c8187" returned: 0 in 0.803s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-dd1bdeea-afc2-40be-b227-76bb7a3c8187" released by "delete_volume" :: held 1.812s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Created reservations ['db0bf19c-c737-4d0c-b432-c3b76def42e0', 'b6d696f6-37d8-4ed0-a37b-0ccc25ee3cb0', '41418d5b-63f0-44c2-916d-bbd85299a3c2', 'e573a0b3-ed3b-4679-9654-fe7e842ff5e6'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:36 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:36 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-62dcbb31-5177-487a-bec0-b53ab90994cb-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-62dcbb31-5177-487a-bec0-b53ab90994cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "cinder-quobyte-62dcbb31-5177-487a-bec0-b53ab90994cb" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-62dcbb31-5177-487a-bec0-b53ab90994cb" acquired by "delete_volume" :: waited 0.023s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f5ef0e-df49-46c2-bf52-969c24f54703]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:36 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:36 devstack sudo[114951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb Jun 27 20:16:36 devstack sudo[114951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:37 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.941s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:37 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:37 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Deleted volume successfully. Jun 27 20:16:37 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-074d93bf-848f-4388-a88e-1312a1e13cc8 tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-dd1bdeea-afc2-40be-b227-76bb7a3c8187-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:37 devstack sudo[114951]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb" returned: 0 in 0.954s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:37 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:37 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb Jun 27 20:16:37 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:38 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-62dcbb31-5177-487a-bec0-b53ab90994cb" returned: 0 in 0.762s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-quobyte-62dcbb31-5177-487a-bec0-b53ab90994cb" released by "delete_volume" :: held 1.774s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Created reservations ['d5638076-a7df-4c76-bc7c-cd1a5b47afe6', '7e1689b7-ddf5-49d5-a38e-20d6bb218e58', 'c228f0dc-124b-49c2-a9a5-8763075a3bed', 'c2739b02-e959-4dfe-b51e-f73e6fb1748c'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:38 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:38 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:38 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:39 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:39 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.948s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:39 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:39 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Deleted volume successfully. Jun 27 20:16:39 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-8bc3d1c9-86c4-4020-9c47-0267c8a4663d tempest-VolumeDependencyTests-1039115333 None] Lock "cinder-62dcbb31-5177-487a-bec0-b53ab90994cb-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Flow 'volume_create_manager' (7a26d1bb-0904-46ca-88de-a0473f0d1728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cec5bf-2639-407a-b384-daaeb3795e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cec5bf-2639-407a-b384-daaeb3795e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2085488014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0b646ec0c2475a9774f413b45935df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:41Z,use_quota=True,user_id='240a36865ca5415a9d6b4b07e982abc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc26fa57-4ac9-46c2-aae5-8a4af45ce3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc26fa57-4ac9-46c2-aae5-8a4af45ce3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c17cbde-4004-4622-8b9b-9ffd53e947ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c17cbde-4004-4622-8b9b-9ffd53e947ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32', 'volume_name': 'volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745024f5-2c91-4979-a881-01438f035e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745024f5-2c91-4979-a881-01438f035e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64a4f2-c2a0-40f3-b8e2-bd6ef0c7d6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:40 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Volume 4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32', 'volume_size': 1} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2085488014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0b646ec0c2475a9774f413b45935df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:41Z,use_quota=True,user_id='240a36865ca5415a9d6b4b07e982abc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Creating volume 4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:40 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:40 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:40 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 1073741824 Jun 27 20:16:40 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:41 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 1073741824" returned: 0 in 0.859s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:41 devstack sudo[114970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:16:41 devstack sudo[114970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Flow 'volume_create_manager' (a814f13b-ea64-41ad-8c11-3e67fb989b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b54a912-4915-4811-a10f-92917c794126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b54a912-4915-4811-a10f-92917c794126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2660edf-136a-40f1-afe0-0c46f180db6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893a0f04676b450e86037945840f325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:42Z,use_quota=True,user_id='9c31608793244af78e2e19cc543eae0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abb2370-a845-43d8-8f39-581cfeebc41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abb2370-a845-43d8-8f39-581cfeebc41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49945af2-6e64-45f1-b21f-1cc848eecbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:41 devstack cinder-volume[93503]: DEBUG cinder.image.glance [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Creating Keystone auth plugin from conf {{(pid=93503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49945af2-6e64-45f1-b21f-1cc848eecbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2660edf-136a-40f1-afe0-0c46f180db6b', 'volume_name': 'volume-e2660edf-136a-40f1-afe0-0c46f180db6b', 'volume_size': 1, 'image_id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec6df02e-749f-4e5f-a925-4d1b446720b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '829ea60abe5589ffe03cf81f9ce26b90', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '893a0f04676b450e86037945840f325d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7bb082b0874264bc81c70378df1991a1a86b3a55d668eadd2845bae8202449417c3e1c5c26c79e4c795cd8a0403215b4b9215ec2d789c80308d37567942890c', 'id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'created_at': datetime.datetime(2026, 6, 27, 18, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec6df02e-749f-4e5f-a925-4d1b446720b1/file', 'properties': {}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64a40db-2f4c-4b2c-9a45-b7f2cacd2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64a40db-2f4c-4b2c-9a45-b7f2cacd2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ff8ce7-079a-42d4-a7d9-f4d81b1abce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:42 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Volume e2660edf-136a-40f1-afe0-0c46f180db6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2660edf-136a-40f1-afe0-0c46f180db6b', 'volume_size': 1, 'image_id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec6df02e-749f-4e5f-a925-4d1b446720b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '829ea60abe5589ffe03cf81f9ce26b90', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '893a0f04676b450e86037945840f325d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7bb082b0874264bc81c70378df1991a1a86b3a55d668eadd2845bae8202449417c3e1c5c26c79e4c795cd8a0403215b4b9215ec2d789c80308d37567942890c', 'id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'created_at': datetime.datetime(2026, 6, 27, 18, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec6df02e-749f-4e5f-a925-4d1b446720b1/file', 'properties': {}}, 'image_service': } Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Trying to clone e2660edf-136a-40f1-afe0-0c46f180db6b from image ec6df02e-749f-4e5f-a925-4d1b446720b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec6df02e-749f-4e5f-a925-4d1b446720b1', 'metadata': {}}]). {{(pid=93503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 27 20:16:42 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Image download 0.00 MB at 0.00 MB/s Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7abc932-6b27-45fe-8a32-866236d63f21]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:42 devstack sudo[114973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD Jun 27 20:16:42 devstack sudo[114973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:42 devstack sudo[114970]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.691s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64a4f2-c2a0-40f3-b8e2-bd6ef0c7d6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee4bf1d-2d6b-4622-92a2-eb418076c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:42 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Volume volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 (4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32): created successfully Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee4bf1d-2d6b-4622-92a2-eb418076c866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Flow 'volume_create_manager' (7a26d1bb-0904-46ca-88de-a0473f0d1728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:42 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-fc1b32a8-4bcd-4647-a3b8-1dd43242f2ea tempest-SnapshotDependencyTests-30321520 None] Created volume successfully. Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Creating offline snapshot 169653da-8bca-4ef1-a80e-751ea25a9d61 of volume 4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e69d23-ca46-4ca8-b1c5-4abe99008dab]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:42 devstack sudo[114973]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:42 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:43 devstack sudo[114977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:16:43 devstack sudo[114977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:43 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD Jun 27 20:16:43 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:43 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Temporary image ec6df02e-749f-4e5f-a925-4d1b446720b1 is fetched for user 9c31608793244af78e2e19cc543eae0e. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 27 20:16:43 devstack sudo[114977]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.798s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:43 devstack sudo[114987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 1G Jun 27 20:16:43 devstack sudo[114987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a4737-831e-44be-8b1f-338ad79bf574]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:43 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:43 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD Jun 27 20:16:43 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:44 devstack sudo[114987]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 1G" returned: 0 in 0.801s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:44 devstack sudo[114997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 Jun 27 20:16:44 devstack sudo[114997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:44 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:44 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:44 devstack sudo[114999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD Jun 27 20:16:44 devstack sudo[114999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:45 devstack sudo[114997]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61" returned: 0 in 0.703s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:45 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 is being set with open permissions: ugo+rw Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:45 devstack sudo[115007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 Jun 27 20:16:45 devstack sudo[115007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:45 devstack sudo[114999]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD" returned: 1 in 0.709s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:45 devstack sudo[115007]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61" returned: 0 in 0.640s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:45 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:45 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info Jun 27 20:16:45 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:46 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info" returned: 0 in 0.641s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:46 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info is being set with open permissions: ugo+rw Jun 27 20:16:46 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:46 devstack sudo[115013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info Jun 27 20:16:46 devstack sudo[115013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:47 devstack sudo[115013]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.info" returned: 0 in 0.630s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.303s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2660edf-136a-40f1-afe0-0c46f180db6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893a0f04676b450e86037945840f325d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:42Z,use_quota=True,user_id='9c31608793244af78e2e19cc543eae0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Creating volume e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:47 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:47 devstack sudo[115016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b 1073741824 Jun 27 20:16:47 devstack sudo[115016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:47 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-ac3c413b-717e-435c-b92a-8063ed38fdbd tempest-SnapshotDependencyTests-30321520 None] Create snapshot completed successfully Jun 27 20:16:47 devstack sudo[115016]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:47 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b 1073741824" returned: 0 in 0.785s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:48 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:48 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:16:48 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Flow 'volume_create_manager' (8fc8c5ea-cc03-4447-8bcd-f200f4d64a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fa855-993d-4cdb-ba3e-95476f0cdc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 0 in 0.695s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fa855-993d-4cdb-ba3e-95476f0cdc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb68caf-65d3-4d74-89dc-b1b1d407813a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0b646ec0c2475a9774f413b45935df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=169653da-8bca-4ef1-a80e-751ea25a9d61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:16:49Z,use_quota=True,user_id='240a36865ca5415a9d6b4b07e982abc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cda123-637e-4f27-867a-88cf36e48f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cda123-637e-4f27-867a-88cf36e48f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66b84a-1209-4d68-a0c5-db7c98292749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66b84a-1209-4d68-a0c5-db7c98292749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abb68caf-65d3-4d74-89dc-b1b1d407813a', 'volume_name': 'volume-abb68caf-65d3-4d74-89dc-b1b1d407813a', 'volume_size': 1, 'snapshot_id': '169653da-8bca-4ef1-a80e-751ea25a9d61'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f003a9ff-68be-44bb-819a-deebdaaff7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f003a9ff-68be-44bb-819a-deebdaaff7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fcdd65-f3e3-4061-bf3e-069d12811385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:48 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Volume abb68caf-65d3-4d74-89dc-b1b1d407813a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abb68caf-65d3-4d74-89dc-b1b1d407813a', 'volume_size': 1, 'snapshot_id': '169653da-8bca-4ef1-a80e-751ea25a9d61'} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-quobyte-169653da-8bca-4ef1-a80e-751ea25a9d61-abb68caf-65d3-4d74-89dc-b1b1d407813a" by "_create_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Attempting download of ec6df02e-749f-4e5f-a925-4d1b446720b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec6df02e-749f-4e5f-a925-4d1b446720b1', 'metadata': {}}])) to volume e2660edf-136a-40f1-afe0-0c46f180db6b. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-169653da-8bca-4ef1-a80e-751ea25a9d61-abb68caf-65d3-4d74-89dc-b1b1d407813a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Creating volume abb68caf-65d3-4d74-89dc-b1b1d407813a from snapshot 169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-quobyte-abb68caf-65d3-4d74-89dc-b1b1d407813a" by "_copy_volume_from_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-abb68caf-65d3-4d74-89dc-b1b1d407813a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] snapshot: 169653da-8bca-4ef1-a80e-751ea25a9d61, volume: abb68caf-65d3-4d74-89dc-b1b1d407813a, {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e11ea-5c79-48a7-b4e8-5e9b81434d30]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b188627-b867-4731-8906-f0c62156e30c]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:48 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:48 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt Jun 27 20:16:48 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:48 devstack sudo[115026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 Jun 27 20:16:48 devstack sudo[115026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:49 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt" returned: 0 in 0.742s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:49 devstack sudo[115026]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61" returned: 0 in 0.774s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Creating direct copy from snapshot {{(pid=93503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d777ffb-2fdf-4fd9-b074-22365e5b0538]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:49 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:49 devstack sudo[115034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt Jun 27 20:16:49 devstack sudo[115034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:49 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:16:49 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:50 devstack sudo[115034]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt" returned: 1 in 0.711s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec6df02e-749f-4e5f-a925-4d1b446720b1_fjmznjpt' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceeecdf-749a-497c-963a-fd6e4e0775b2]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:50 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD Jun 27 20:16:50 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:50 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.796s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG cinder.utils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Path /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a not found in is_blk_device check {{(pid=93503) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 27 20:16:50 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:50 devstack sudo[115045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a Jun 27 20:16:50 devstack sudo[115045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:50 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:51 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:51 devstack sudo[115049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD Jun 27 20:16:51 devstack sudo[115049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:52 devstack sudo[115049]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD" returned: 1 in 1.036s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:52 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] ec6df02e-749f-4e5f-a925-4d1b446720b1 was raw, converting to raw {{(pid=93503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 27 20:16:52 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:52 devstack sudo[115064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:52 devstack sudo[115064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:53 devstack sudo[115064]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 0 in 1.439s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:53 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec6df02e-749f-4e5f-a925-4d1b446720b1_dnaq_0wtdevstack@QuobyteHD, size 0.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:16:53 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 20:16:53 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:53 devstack sudo[115070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b 1G Jun 27 20:16:53 devstack sudo[115070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:54 devstack sudo[115070]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b 1G" returned: 0 in 1.174s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:54 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3deafa-2a28-429e-afaf-3c23e08e11fc]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:54 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:54 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:55 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:55 devstack sudo[115045]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a" returned: 0 in 5.146s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:55 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f059a603-025a-4f29-adb3-7d61784f638d]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:55 devstack sudo[115078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:16:55 devstack sudo[115078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:55 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 0 in 1.051s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:55 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:55 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:55 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:56 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 1 in 0.733s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:56 devstack sudo[115078]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Downloaded image ec6df02e-749f-4e5f-a925-4d1b446720b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec6df02e-749f-4e5f-a925-4d1b446720b1', 'metadata': {}}])) to volume e2660edf-136a-40f1-afe0-0c46f180db6b successfully. {{(pid=93503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Temporary image ec6df02e-749f-4e5f-a925-4d1b446720b1 for user 9c31608793244af78e2e19cc543eae0e is deleted. {{(pid=93503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.volume_utils [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Marking volume e2660edf-136a-40f1-afe0-0c46f180db6b as bootable. {{(pid=93503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.948s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.image.image_utils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Image conversion details: src /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a {{(pid=93503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 27 20:16:56 devstack cinder-volume[93503]: INFO cinder.image.image_utils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Converted 1024.00 MB image at 198.91 MB/s Jun 27 20:16:56 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a is being set with open permissions: ugo+rw Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Copying metadata from image ec6df02e-749f-4e5f-a925-4d1b446720b1 to e2660edf-136a-40f1-afe0-0c46f180db6b. {{(pid=93503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Creating volume glance metadata for volume e2660edf-136a-40f1-afe0-0c46f180db6b backed by image ec6df02e-749f-4e5f-a925-4d1b446720b1 with: {'image_id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '829ea60abe5589ffe03cf81f9ce26b90', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 20:16:56 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a Jun 27 20:16:56 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ff8ce7-079a-42d4-a7d9-f4d81b1abce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2660edf-136a-40f1-afe0-0c46f180db6b', 'volume_size': 1, 'image_id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec6df02e-749f-4e5f-a925-4d1b446720b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '829ea60abe5589ffe03cf81f9ce26b90', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '893a0f04676b450e86037945840f325d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7bb082b0874264bc81c70378df1991a1a86b3a55d668eadd2845bae8202449417c3e1c5c26c79e4c795cd8a0403215b4b9215ec2d789c80308d37567942890c', 'id': 'ec6df02e-749f-4e5f-a925-4d1b446720b1', 'created_at': datetime.datetime(2026, 6, 27, 18, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 18, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec6df02e-749f-4e5f-a925-4d1b446720b1/file', 'properties': {}}, 'image_service': }' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56af03d5-8784-484a-8f82-ccc82265fed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:56 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Volume volume-e2660edf-136a-40f1-afe0-0c46f180db6b (e2660edf-136a-40f1-afe0-0c46f180db6b): created successfully Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56af03d5-8784-484a-8f82-ccc82265fed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Flow 'volume_create_manager' (a814f13b-ea64-41ad-8c11-3e67fb989b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:56 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-72cabb67-ec05-4162-b6e9-f6219c96dfe6 tempest-VolumeImageDependencyTests-281499565 None] Created volume successfully. Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Acquiring lock "cinder-e2660edf-136a-40f1-afe0-0c46f180db6b-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Lock "cinder-e2660edf-136a-40f1-afe0-0c46f180db6b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Acquiring lock "cinder-quobyte-e2660edf-136a-40f1-afe0-0c46f180db6b" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:56 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Lock "cinder-quobyte-e2660edf-136a-40f1-afe0-0c46f180db6b" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a5411a-8174-4bf0-b968-0ca281a868a6]: (4, 'raw') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:57 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:57 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:57 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a" returned: 0 in 0.671s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-abb68caf-65d3-4d74-89dc-b1b1d407813a" released by "_copy_volume_from_snapshot" :: held 8.436s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-169653da-8bca-4ef1-a80e-751ea25a9d61-abb68caf-65d3-4d74-89dc-b1b1d407813a" released by "_create_volume_from_snapshot" :: held 8.470s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.488s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fcdd65-f3e3-4061-bf3e-069d12811385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb68caf-65d3-4d74-89dc-b1b1d407813a', 'volume_size': 1, 'snapshot_id': '169653da-8bca-4ef1-a80e-751ea25a9d61'}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a744f8-4502-4695-8571-b897002fd7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:16:57 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Volume volume-abb68caf-65d3-4d74-89dc-b1b1d407813a (abb68caf-65d3-4d74-89dc-b1b1d407813a): created successfully Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a744f8-4502-4695-8571-b897002fd7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Flow 'volume_create_manager' (8fc8c5ea-cc03-4447-8bcd-f200f4d64a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:16:57 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-dbb99e2d-7714-48c6-8059-a086d2c6b57d tempest-SnapshotDependencyTests-30321520 None] Created volume successfully. Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-169653da-8bca-4ef1-a80e-751ea25a9d61-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-169653da-8bca-4ef1-a80e-751ea25a9d61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-quobyte-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-quobyte-169653da-8bca-4ef1-a80e-751ea25a9d61" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-169653da-8bca-4ef1-a80e-751ea25a9d61" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Deleting offline snapshot 169653da-8bca-4ef1-a80e-751ea25a9d61 of volume 4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] snapshot_file for this snap is: volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[289c7b69-da0b-4ecb-bdae-8d3122097a32]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:57 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 Jun 27 20:16:57 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:57 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 0 in 0.777s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:57 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:57 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:57 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:58 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61" returned: 0 in 0.789s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[795e73b8-b6d2-46c5-9d4e-87409ae98f29]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:58 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 1 in 0.727s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b' failed. Not Retrying. {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 20:16:58 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:58 devstack sudo[115107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:16:58 devstack sudo[115107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:58 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b Jun 27 20:16:58 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:59 devstack sudo[115107]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:59 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.750s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-e2660edf-136a-40f1-afe0-0c46f180db6b" returned: 0 in 0.674s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Lock "cinder-quobyte-e2660edf-136a-40f1-afe0-0c46f180db6b" released by "delete_volume" :: held 2.241s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:16:59 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 Jun 27 20:16:59 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Created reservations ['8fe340ed-69b7-4c08-b95b-95bcaa77b07f', 'f933bcef-0328-4ae7-9383-8e164b8d444c', '39b38695-18de-44ad-bf10-6563b8218635', 'a1515b7d-1801-4c56-a12c-71a01b062c67'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:59 devstack sudo[115117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:16:59 devstack sudo[115117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:59 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61" returned: 0 in 0.737s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:16:59 devstack sudo[115117]: pam_unix(sudo:session): session closed for user root Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.615s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:16:59 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Deleted volume successfully. Jun 27 20:16:59 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61 Jun 27 20:16:59 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:16:59 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-27263387-7b70-40d9-a4cd-d608ccaf020e tempest-VolumeImageDependencyTests-281499565 None] Lock "cinder-e2660edf-136a-40f1-afe0-0c46f180db6b-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:00 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:00 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32.169653da-8bca-4ef1-a80e-751ea25a9d61" returned: 0 in 0.670s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-169653da-8bca-4ef1-a80e-751ea25a9d61" released by "_delete_snapshot" :: held 3.048s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" released by "delete_snapshot" :: held 3.069s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:00 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Created reservations ['f9a446e6-4745-4b24-bdb0-0d6d45f27f89', '502d4174-a7ce-4eab-8ce5-9ae2320d4f6d', 'e0abb37d-e0de-4cc0-9093-313a79261dd4', 'f2193e25-1902-440f-90b7-e9c73e7c1898'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:17:00 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Delete snapshot completed successfully. Jun 27 20:17:00 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1893fb94-dc7e-4a36-bf9c-51d571b572be tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-169653da-8bca-4ef1-a80e-751ea25a9d61-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-quobyte-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:01 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" acquired by "delete_volume" :: waited 0.014s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:01 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[029994bd-a75d-4cb0-9d54-bbdc46dff257]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:01 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:02 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:17:02 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:02 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:02 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:02 devstack sudo[115136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32 Jun 27 20:17:02 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Flow 'volume_create_manager' (d0ec7bdb-fa38-4ada-bb40-e51c9d333722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c29f79f-17c0-45c0-bef1-3936cd067a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c29f79f-17c0-45c0-bef1-3936cd067a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ff5666-38a0-4efb-97c7-82d01951d5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5096d80329fc47278ea0502e775b2b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:17:03Z,use_quota=True,user_id='78f2b0a3066149729e4626d5950ea7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40ddc8b-4d7f-4a50-98c2-a6d37832e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40ddc8b-4d7f-4a50-98c2-a6d37832e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d4aa8c-1653-478b-ade9-ea9211b55f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d4aa8c-1653-478b-ade9-ea9211b55f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ff5666-38a0-4efb-97c7-82d01951d5a2', 'volume_name': 'volume-56ff5666-38a0-4efb-97c7-82d01951d5a2', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaad7d3-1218-4d61-9db6-8586b95d19f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaad7d3-1218-4d61-9db6-8586b95d19f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a0259a-5594-429b-90f3-73690fd4c70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:03 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Volume 56ff5666-38a0-4efb-97c7-82d01951d5a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ff5666-38a0-4efb-97c7-82d01951d5a2', 'volume_size': 1} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ff5666-38a0-4efb-97c7-82d01951d5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5096d80329fc47278ea0502e775b2b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:17:03Z,use_quota=True,user_id='78f2b0a3066149729e4626d5950ea7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Creating volume 56ff5666-38a0-4efb-97c7-82d01951d5a2 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:17:03 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:03 devstack sudo[115139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 1073741824 Jun 27 20:17:03 devstack sudo[115139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:03 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" returned: 0 in 0.677s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32" released by "delete_volume" :: held 1.515s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Created reservations ['e48dab6d-5058-4b39-911f-80c0b75e636b', '880ad6c6-00d8-4d7f-b4eb-811404fe1a52', '81fa7429-3559-4abb-8f06-dea4506a6079', '1b8458bd-3ec5-441c-b63a-bf54066713a2'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:03 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:03 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:17:03 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-abb68caf-65d3-4d74-89dc-b1b1d407813a-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-abb68caf-65d3-4d74-89dc-b1b1d407813a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:04 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.688s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "cinder-quobyte-abb68caf-65d3-4d74-89dc-b1b1d407813a" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:04 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Deleted volume successfully. Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-11038e03-76c3-4b90-8603-074a5ba2b2f9 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-4ead3c79-a9ca-4d65-a3fa-452d4b3d8e32-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-abb68caf-65d3-4d74-89dc-b1b1d407813a" acquired by "delete_volume" :: waited 0.032s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837a7db-1456-4da4-9317-831c109a0206]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:04 devstack sudo[115139]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 1073741824" returned: 0 in 0.964s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:04 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 Jun 27 20:17:04 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:04 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a Jun 27 20:17:04 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:04 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2" returned: 0 in 0.655s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a0259a-5594-429b-90f3-73690fd4c70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ff5666-38a0-4efb-97c7-82d01951d5a2', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afab5359-d5cb-4bfa-9e6a-fa58a7d05ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:04 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Volume volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 (56ff5666-38a0-4efb-97c7-82d01951d5a2): created successfully Jun 27 20:17:04 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afab5359-d5cb-4bfa-9e6a-fa58a7d05ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:04 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Flow 'volume_create_manager' (d0ec7bdb-fa38-4ada-bb40-e51c9d333722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a" returned: 0 in 0.762s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:05 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-47d7dff0-72e5-4881-9132-b6817891c566 tempest-CinderUnicodeTest-1090713769 None] Created volume successfully. Jun 27 20:17:05 devstack sudo[115159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a Jun 27 20:17:05 devstack sudo[115159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:05 devstack sudo[115159]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-abb68caf-65d3-4d74-89dc-b1b1d407813a" returned: 0 in 0.643s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-quobyte-abb68caf-65d3-4d74-89dc-b1b1d407813a" released by "delete_volume" :: held 1.446s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Created reservations ['812ba5a3-cb52-4b73-9375-f0d2e4bd31e6', '209df2fe-42a1-4c3e-9d98-966fd33b03c1', '605fc6ce-f534-43f2-b63e-0964e516a36f', '0f6f3047-69fc-49d5-855e-26f769e00411'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:05 devstack sudo[115162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:17:05 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Flow 'volume_create_manager' (4c47f7e7-5097-4b11-9952-967472f519db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6e546a-8ffd-4380-b385-7967d9f07e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6e546a-8ffd-4380-b385-7967d9f07e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:17:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1856187487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a66154-39fc-439b-ab59-f11afcc83323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5096d80329fc47278ea0502e775b2b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:17:06Z,use_quota=True,user_id='78f2b0a3066149729e4626d5950ea7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27ad34e-2960-4418-8c11-eed660ed07ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27ad34e-2960-4418-8c11-eed660ed07ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535a698d-16ff-4979-a9c9-c48da30397e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535a698d-16ff-4979-a9c9-c48da30397e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a66154-39fc-439b-ab59-f11afcc83323', 'volume_name': 'volume-61a66154-39fc-439b-ab59-f11afcc83323', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8293d04a-52be-41a3-85aa-df7d01238cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8293d04a-52be-41a3-85aa-df7d01238cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678cf774-a4e3-42c1-b489-8e7d8fb07abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:05 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Volume 61a66154-39fc-439b-ab59-f11afcc83323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a66154-39fc-439b-ab59-f11afcc83323', 'volume_size': 1} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T18:17:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1856187487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a66154-39fc-439b-ab59-f11afcc83323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5096d80329fc47278ea0502e775b2b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T18:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T18:17:06Z,use_quota=True,user_id='78f2b0a3066149729e4626d5950ea7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd),volume_type_id=3f7e5a39-5d10-44a2-9a1e-e4647c6c0dfd)}" {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Creating volume 61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Selected osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 as target Quobyte volume. {{(pid=93503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 20:17:05 devstack cinder-volume[93503]: INFO cinder.volume.drivers.remotefs [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] casted to osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19 Jun 27 20:17:05 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 1073741824 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:05 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 1073741824 Jun 27 20:17:05 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:06 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.658s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:06 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:17:06 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Deleted volume successfully. Jun 27 20:17:06 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-b5fd8aa5-1e27-466b-9e11-0559ff94b1d0 tempest-SnapshotDependencyTests-30321520 None] Lock "cinder-abb68caf-65d3-4d74-89dc-b1b1d407813a-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:06 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 1073741824" returned: 0 in 0.858s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:06 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:06 devstack sudo[115171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 Jun 27 20:17:06 devstack sudo[115171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:07 devstack sudo[115171]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323" returned: 0 in 0.688s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'} {{(pid=93503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678cf774-a4e3-42c1-b489-8e7d8fb07abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a66154-39fc-439b-ab59-f11afcc83323', 'volume_size': 1}' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac6677e-d496-4715-8c43-57db5ba623fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 20:17:07 devstack cinder-volume[93503]: INFO cinder.volume.flows.manager.create_volume [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Volume volume-61a66154-39fc-439b-ab59-f11afcc83323 (61a66154-39fc-439b-ab59-f11afcc83323): created successfully Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac6677e-d496-4715-8c43-57db5ba623fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 20:17:07 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Flow 'volume_create_manager' (4c47f7e7-5097-4b11-9952-967472f519db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 20:17:07 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-c0f222d8-b280-4f2d-8bd2-cf615f963ffe tempest-CinderUnicodeTest-1090713769 None] Created volume successfully. Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Creating offline snapshot eed61792-20b1-48f6-9c9d-38d537088aeb of volume 61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da82ee-9754-41c9-9651-66a3efb3abff]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:08 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 Jun 27 20:17:08 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:08 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323" returned: 0 in 0.799s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:08 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb 1G {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:09 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb 1G Jun 27 20:17:09 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:09 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb 1G" returned: 0 in 0.930s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:09 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a66154-39fc-439b-ab59-f11afcc83323 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:09 devstack sudo[115193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a66154-39fc-439b-ab59-f11afcc83323 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb Jun 27 20:17:09 devstack sudo[115193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:10 devstack sudo[115193]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a66154-39fc-439b-ab59-f11afcc83323 -F qcow2 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb" returned: 0 in 0.721s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:10 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb is being set with open permissions: ugo+rw Jun 27 20:17:10 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:10 devstack sudo[115199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb Jun 27 20:17:10 devstack sudo[115199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:11 devstack sudo[115199]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb" returned: 0 in 0.699s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:11 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info Jun 27 20:17:11 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:11 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info" returned: 0 in 0.624s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:11 devstack cinder-volume[93503]: WARNING cinder.volume.drivers.remotefs [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info is being set with open permissions: ugo+rw Jun 27 20:17:11 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:12 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info Jun 27 20:17:12 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:12 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.info" returned: 0 in 0.737s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:12 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:12 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-455d6d5a-0da0-4993-b33d-9321fee7c941 tempest-CinderUnicodeTest-1090713769 None] Create snapshot completed successfully Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-eed61792-20b1-48f6-9c9d-38d537088aeb-delete_snapshot" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-eed61792-20b1-48f6-9c9d-38d537088aeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-quobyte-61a66154-39fc-439b-ab59-f11afcc83323" by "delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-61a66154-39fc-439b-ab59-f11afcc83323" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-quobyte-eed61792-20b1-48f6-9c9d-38d537088aeb" by "_delete_snapshot" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-eed61792-20b1-48f6-9c9d-38d537088aeb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Deleting offline snapshot eed61792-20b1-48f6-9c9d-38d537088aeb of volume 61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] snapshot_file for this snap is: volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb {{(pid=93503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7efe0-3933-46cd-b3a7-28322a4d5695]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:13 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:13 devstack sudo[115210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb Jun 27 20:17:13 devstack sudo[115210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:14 devstack sudo[115210]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb" returned: 0 in 0.832s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:14 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.remotefs [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61a66154-39fc-439b-ab59-f11afcc83323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 20:17:14 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9d221-7dc2-433b-88e6-a889bca97eea]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:14 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:14 devstack sudo[115215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 Jun 27 20:17:14 devstack sudo[115215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:15 devstack sudo[115215]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323" returned: 0 in 0.780s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:15 devstack sudo[115221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb Jun 27 20:17:15 devstack sudo[115221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:15 devstack sudo[115221]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb" returned: 0 in 0.723s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:15 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:15 devstack sudo[115226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb Jun 27 20:17:15 devstack sudo[115226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-d306419b-968d-48bd-ada7-62226093288f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:16 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:17:16 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:16 devstack sudo[115226]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323.eed61792-20b1-48f6-9c9d-38d537088aeb" returned: 0 in 0.635s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-eed61792-20b1-48f6-9c9d-38d537088aeb" released by "_delete_snapshot" :: held 3.084s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-61a66154-39fc-439b-ab59-f11afcc83323" released by "delete_snapshot" :: held 3.108s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Created reservations ['8493aefe-fb7c-42b6-98f7-8f53e3988ee2', 'da4d50f0-d6bb-4993-b5d3-504c1d269c8e', 'f8ca8e0e-e0cf-4e51-9ea0-53d2f883b7f6', '301473ef-36ab-4226-8848-a97df1250191'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:17:16 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Delete snapshot completed successfully. Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-9792a650-2de6-426b-9176-f4abfe7dcd60 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-eed61792-20b1-48f6-9c9d-38d537088aeb-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:16 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-d306419b-968d-48bd-ada7-62226093288f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.625s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG oslo_service.periodic_task [None req-d306419b-968d-48bd-ada7-62226093288f None None] Running periodic task VolumeManager._thread_info {{(pid=93503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread count: 28 {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 27 20:17:16 devstack cinder-volume[93503]: DEBUG cinder.volume.manager [None req-d306419b-968d-48bd-ada7-62226093288f None None] thread info: [<_MainThread(MainThread, started 131719907586176)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93503) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 27 20:17:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-61a66154-39fc-439b-ab59-f11afcc83323-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-61a66154-39fc-439b-ab59-f11afcc83323-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-quobyte-61a66154-39fc-439b-ab59-f11afcc83323" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:17 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-61a66154-39fc-439b-ab59-f11afcc83323" acquired by "delete_volume" :: waited 0.018s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:17 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[054eb12c-9d60-4b0a-9145-32c91d923736]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:17 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:17 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 Jun 27 20:17:17 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:18 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323" returned: 0 in 0.758s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:18 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:18 devstack sudo[115237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323 Jun 27 20:17:18 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:19 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-61a66154-39fc-439b-ab59-f11afcc83323" returned: 0 in 0.632s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-61a66154-39fc-439b-ab59-f11afcc83323" released by "delete_volume" :: held 1.444s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Created reservations ['fc0e2c87-8da5-448c-91c5-a4d7c718e406', '74793507-71b1-4d0a-81e0-22e898b3bacf', '657ed2d0-58f1-4e75-8ac6-f075e9951593', '4f28c5b5-0e25-4602-b5e2-9104a84ffdab'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:19 devstack sudo[115241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:17:19 devstack sudo[115241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-56ff5666-38a0-4efb-97c7-82d01951d5a2-delete_volume" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:19 devstack sudo[115241]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.620s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-56ff5666-38a0-4efb-97c7-82d01951d5a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:19 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Deleted volume successfully. Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-1150b3fa-ece2-4526-8fab-a012ac2ad2f7 tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-61a66154-39fc-439b-ab59-f11afcc83323-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "cinder-quobyte-56ff5666-38a0-4efb-97c7-82d01951d5a2" by "delete_volume" {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-56ff5666-38a0-4efb-97c7-82d01951d5a2" acquired by "delete_volume" :: waited 0.016s {{(pid=93503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo.privsep.daemon [-] privsep: reply[481dc69b-41df-4480-bf64-28fa36b449c9]: (4, 'qcow2') {{(pid=94950) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 20:17:19 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:20 devstack sudo[115244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 Jun 27 20:17:20 devstack sudo[115244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:20 devstack sudo[115244]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2" returned: 0 in 0.765s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:20 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:20 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2 Jun 27 20:17:20 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:21 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9/volume-56ff5666-38a0-4efb-97c7-82d01951d5a2" returned: 0 in 0.650s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-quobyte-56ff5666-38a0-4efb-97c7-82d01951d5a2" released by "delete_volume" :: held 1.457s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG cinder.quota [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Created reservations ['5782fd69-1367-48f5-bf8e-de399e1b14fb', 'fbe5e6ec-dfe3-485e-ae7c-316b8e75256b', 'ceec682f-20c2-464d-8221-69fb3e78e873', '3ae82451-84d7-4eb8-865e-ddcaf3d033bc'] {{(pid=93503) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19': None} {{(pid=93503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG cinder.volume.drivers.quobyte [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8cae7ef4-a6eb-43f2-96d4-6c609df3cc19'] {{(pid=93503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.lockutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 20:17:21 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 20:17:21 devstack sudo[115252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9 Jun 27 20:17:21 devstack sudo[115252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 20:17:22 devstack sudo[115252]: pam_unix(sudo:session): session closed for user root Jun 27 20:17:22 devstack cinder-volume[93503]: DEBUG oslo_concurrency.processutils [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c58230243ff40495cefbe70a57a9e1f9" returned: 0 in 0.638s {{(pid=93503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 20:17:22 devstack cinder-volume[93503]: DEBUG cinder.manager [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Notifying Schedulers of capabilities ... {{(pid=93503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 27 20:17:22 devstack cinder-volume[93503]: INFO cinder.volume.manager [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Deleted volume successfully. Jun 27 20:17:22 devstack cinder-volume[93503]: DEBUG cinder.coordination [None req-441ab3b5-1bbc-4085-89b8-ac3a5d24ca4a tempest-CinderUnicodeTest-1090713769 None] Lock "cinder-56ff5666-38a0-4efb-97c7-82d01951d5a2-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=93503) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 20:17:31 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:INSERT=34,cinder:UPDATE=113,cinder:SELECT=90,cinder:DELETE=13 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 20:17:32 devstack cinder-volume[93503]: DEBUG dbcounter [-] [93503] Writing DB stats cinder:SELECT=74,cinder:INSERT=29,cinder:UPDATE=99,cinder:DELETE=4 {{(pid=93503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}